Jun 12 21:42:45.204166 ip-10-0-142-94 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 21:42:45.204181 ip-10-0-142-94 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 21:42:45.204190 ip-10-0-142-94 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 21:42:45.204511 ip-10-0-142-94 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 21:42:56.387251 ip-10-0-142-94 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 21:42:56.387269 ip-10-0-142-94 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d247697ca631449e99360ba030cad9bd -- Jun 12 21:45:15.435102 ip-10-0-142-94 systemd[1]: Starting Kubernetes Kubelet... Jun 12 21:45:15.878214 ip-10-0-142-94 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:15.878214 ip-10-0-142-94 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 21:45:15.878214 ip-10-0-142-94 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:15.878214 ip-10-0-142-94 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 21:45:15.878214 ip-10-0-142-94 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:15.878887 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.878224 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 21:45:15.884399 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884375 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.884399 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884397 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.884399 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884401 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.884399 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884404 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884408 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884411 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884414 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884417 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884419 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884422 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884427 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884429 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884432 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884435 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884437 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884441 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884444 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884447 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884450 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884456 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884459 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884463 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.884539 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884467 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884470 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884473 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884478 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884481 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884484 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884487 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884490 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884493 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884495 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884498 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884501 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884504 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884507 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884509 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884512 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884515 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884518 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884521 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.885019 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884540 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884544 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884548 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884552 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884555 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884558 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884561 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884564 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884566 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884569 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884571 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884574 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884577 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884579 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884582 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884584 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884586 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884589 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884591 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.885514 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884594 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884597 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884599 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884601 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884604 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884608 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884611 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884614 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884617 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884620 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884623 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884626 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884628 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884631 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884634 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884637 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884639 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884641 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884644 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884646 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.885991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884649 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884652 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884654 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884656 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884659 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884661 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884663 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884666 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884668 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884671 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884673 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884676 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884678 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884700 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884704 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884706 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884709 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884711 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.884714 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885480 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.886479 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885487 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885491 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885495 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885499 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885509 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885513 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885516 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885519 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885522 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885525 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885528 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885531 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885534 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885536 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885541 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885544 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885547 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885549 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885552 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.886991 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885555 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885558 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885560 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885563 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885565 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885568 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885571 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885574 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885577 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885579 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885582 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885584 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885587 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885589 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885593 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885595 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885598 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885600 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885609 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885611 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.887467 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885614 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885616 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885618 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885621 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885624 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885627 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885629 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885631 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885634 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885636 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885639 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885642 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885644 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885647 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885649 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885652 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885655 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885657 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885660 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885663 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.888008 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885665 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885668 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885670 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885673 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885675 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885678 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885681 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885699 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885702 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885704 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885707 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885717 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885720 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885723 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885725 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885728 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885730 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885733 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885735 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885738 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.888502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885740 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885743 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885746 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885749 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885751 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885755 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885757 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885760 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885763 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885765 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885768 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885771 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885773 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885776 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885778 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885782 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885786 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885789 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.885791 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.889017 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886202 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886207 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886210 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886213 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886217 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886219 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886222 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886225 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886228 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886231 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886238 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886241 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886244 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886246 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886249 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886251 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886255 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886259 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886262 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886264 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.889572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886267 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886269 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886272 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886275 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886277 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886280 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886283 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886286 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886288 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886291 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886294 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886296 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886299 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886303 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886306 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886309 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886312 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886315 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886318 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886321 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.890106 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886323 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886326 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886331 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886334 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886337 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886340 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886342 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886345 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886348 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886351 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886354 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886356 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886359 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886361 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886364 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886367 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886369 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886372 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886374 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.890596 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886377 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886380 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886382 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886384 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886387 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886389 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886392 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886395 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886397 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886400 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886402 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886408 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886411 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886414 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886417 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886421 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886423 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886426 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886429 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886431 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.891073 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886434 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886438 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886441 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886444 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886447 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886449 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886452 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886455 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886457 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886459 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886462 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886465 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886468 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886470 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886473 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886475 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886478 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886481 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886483 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.891561 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.886486 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886562 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886574 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886581 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886586 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886593 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886596 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886600 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886605 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886608 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886611 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886615 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886618 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886621 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886624 2565 flags.go:64] FLAG: --cgroup-root="" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886627 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886629 2565 flags.go:64] FLAG: --client-ca-file="" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886632 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886635 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886639 2565 flags.go:64] FLAG: --cluster-domain="" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886642 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886645 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886648 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886651 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 21:45:15.892033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886655 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886657 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886660 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886664 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886667 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886669 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886672 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886675 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886678 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886683 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886701 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886704 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886707 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886710 2565 flags.go:64] FLAG: --enable-server="true" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886714 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886719 2565 flags.go:64] FLAG: --event-burst="100" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886722 2565 flags.go:64] FLAG: --event-qps="50" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886725 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886728 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886731 2565 flags.go:64] FLAG: --eviction-hard="" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886735 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886738 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886743 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886746 2565 flags.go:64] FLAG: --eviction-soft="" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886749 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 21:45:15.892601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886752 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886755 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886758 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886760 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886763 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886766 2565 flags.go:64] FLAG: --feature-gates="" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886770 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886773 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886776 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886779 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886782 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886785 2565 flags.go:64] FLAG: --help="false" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886788 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-94.ec2.internal" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886792 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886794 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886797 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886800 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886804 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886807 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886809 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886812 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886815 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886818 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886821 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 21:45:15.893244 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886824 2565 flags.go:64] FLAG: --kube-reserved="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886826 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886829 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886832 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886835 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886839 2565 flags.go:64] FLAG: --lock-file="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886842 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886845 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886848 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886853 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886856 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886858 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886861 2565 flags.go:64] FLAG: --logging-format="text" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886864 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886867 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886870 2565 flags.go:64] FLAG: --manifest-url="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886872 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886877 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886880 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886883 2565 flags.go:64] FLAG: --max-pods="110" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886886 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886889 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886892 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886912 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886916 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 21:45:15.893870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886919 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886922 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886930 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886933 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886936 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886938 2565 flags.go:64] FLAG: --pod-cidr="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886942 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886947 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886950 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886954 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886956 2565 flags.go:64] FLAG: --port="10250" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886959 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886964 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05dc7c54bcd2589e7" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886967 2565 flags.go:64] FLAG: --qos-reserved="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886970 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886972 2565 flags.go:64] FLAG: --register-node="true" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886975 2565 flags.go:64] FLAG: --register-with-taints="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886979 2565 flags.go:64] FLAG: --registry-burst="10" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886982 2565 flags.go:64] FLAG: --registry-qps="5" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886984 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886987 2565 flags.go:64] FLAG: --reserved-memory="" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886991 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886995 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.886998 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887001 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 21:45:15.894492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887003 2565 flags.go:64] FLAG: --runonce="false" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887006 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887009 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887012 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887015 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887018 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887022 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887026 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887029 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887032 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887035 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887038 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887041 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887044 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887047 2565 flags.go:64] FLAG: --system-cgroups="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887050 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887055 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887058 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887061 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887067 2565 flags.go:64] FLAG: --tls-min-version="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887070 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887073 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887075 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887078 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887081 2565 flags.go:64] FLAG: --v="2" Jun 12 21:45:15.895121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887085 2565 flags.go:64] FLAG: --version="false" Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887089 2565 flags.go:64] FLAG: --vmodule="" Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887093 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887096 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887208 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887213 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887216 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887219 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887221 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887224 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887226 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887229 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887232 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887236 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887238 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887241 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887243 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887246 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887249 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887251 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887254 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.895736 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887257 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887259 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887262 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887264 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887267 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887271 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887273 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887276 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887278 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887281 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887283 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887286 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887289 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887293 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887295 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887298 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887301 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887304 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887306 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.896245 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887309 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887311 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887314 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887316 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887318 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887322 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887324 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887327 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887329 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887335 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887337 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887340 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887342 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887345 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887348 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887350 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887352 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887357 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887359 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.896856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887362 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887365 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887367 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887370 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887372 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887375 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887377 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887380 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887382 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887385 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887387 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887389 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887392 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887394 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887397 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887399 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887402 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887405 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887408 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887411 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.897418 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887413 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887415 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887418 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887422 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887425 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887428 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887432 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887435 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887438 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887441 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887445 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887447 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887449 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887452 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887454 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887457 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887459 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887462 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887464 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.897999 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887466 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887469 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887472 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.887474 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.887480 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.894967 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.894988 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.895027 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.895033 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895098 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895105 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895108 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895111 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895113 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895116 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.898457 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895119 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895122 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895124 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895127 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895130 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895133 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895136 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895138 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895141 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895144 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895146 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895149 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895152 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895154 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895156 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895159 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895162 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895164 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895167 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895169 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.898862 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895172 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895174 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895178 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895181 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895184 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895187 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895189 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895192 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895195 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895197 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895200 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895203 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895205 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895208 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895210 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895213 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895215 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895217 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895220 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895222 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.899347 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895225 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895227 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895230 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895232 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895236 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895240 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895243 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895245 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895248 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895250 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895253 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895255 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895258 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895260 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895263 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895266 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895269 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895272 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895275 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.899859 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895277 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895280 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895282 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895285 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895287 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895290 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895292 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895294 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895297 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895299 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895302 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895304 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895307 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895309 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895312 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895314 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895317 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895319 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895322 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895325 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.900311 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895327 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895330 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895336 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895340 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895343 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895346 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895350 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895353 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895355 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895358 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895361 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895364 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.900864 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895367 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.895373 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895494 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895499 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895502 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895505 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895507 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895510 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895513 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895515 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895518 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895520 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895523 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895525 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895528 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:15.901185 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895530 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895533 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895536 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895538 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895541 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895544 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895547 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895550 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895552 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895554 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895557 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895560 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895562 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895565 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895568 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895571 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895573 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895576 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895580 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:15.901564 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895584 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895588 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895592 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895596 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895599 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895602 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895604 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895607 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895610 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895612 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895615 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895617 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895620 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895623 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895625 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895628 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895630 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895634 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895638 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895641 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:15.902039 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895643 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895646 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895649 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895652 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895654 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895658 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895661 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895664 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895666 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895741 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895809 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895816 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895820 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895825 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895834 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895839 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895843 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895847 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895852 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:15.902524 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895856 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895861 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.895865 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897813 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897820 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897954 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897958 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897964 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897969 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897972 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897975 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897979 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897982 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897985 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897987 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897991 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897995 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.897998 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898001 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:15.903030 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898004 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898007 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898010 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898013 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898015 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898018 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898021 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:15.898024 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.898030 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.898204 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.900557 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.902196 2565 server.go:1019] "Starting client certificate rotation" Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.902294 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:45:15.903492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.902326 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:45:15.905187 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.905171 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:45:15.921058 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.906552 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:45:15.921176 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.921124 2565 log.go:25] "Validated CRI v1 runtime API" Jun 12 21:45:15.925015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.924997 2565 log.go:25] "Validated CRI v1 image API" Jun 12 21:45:15.928296 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.928277 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 21:45:15.930978 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.930956 2565 fs.go:135] Filesystem UUIDs: map[1c386379-70ae-4c44-8823-1749ae71a62b:/dev/nvme0n1p3 1f214de9-130d-4b86-a94f-e8507bdead7f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 12 21:45:15.931060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.930976 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 21:45:15.936610 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.936456 2565 manager.go:216] Machine: {Timestamp:2026-06-12 21:45:15.935039226 +0000 UTC m=+0.377873592 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109470 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cdab138b9136c229867b053d56c83 SystemUUID:ec2cdab1-38b9-136c-2298-67b053d56c83 BootID:d247697c-a631-449e-9936-0ba030cad9bd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:7d:70:fb:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:7d:70:fb:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:48:ef:52:ed:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 21:45:15.936783 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.936614 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 21:45:15.936898 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.936824 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 21:45:15.940367 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.940336 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 21:45:15.940533 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.940373 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 21:45:15.941309 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.941298 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 21:45:15.941358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.941312 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 21:45:15.941358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.941320 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:45:15.942115 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.942104 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:45:15.942325 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.942308 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:45:15.943954 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.943941 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 21:45:15.948483 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948470 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:45:15.948652 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948642 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 21:45:15.948708 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948676 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 12 21:45:15.948745 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948720 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 21:45:15.948776 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948751 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 21:45:15.948776 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948771 2565 kubelet.go:398] "Adding apiserver pod source" Jun 12 21:45:15.948840 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.948794 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 21:45:15.949388 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.949363 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:45:15.949388 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.949389 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:45:15.953683 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.953663 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 21:45:15.955568 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.955552 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 21:45:15.955633 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.955585 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 21:45:15.956455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956444 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 21:45:15.956502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956461 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 21:45:15.956502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956468 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 21:45:15.956502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956473 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 21:45:15.956502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956487 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 21:45:15.956502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956496 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956507 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956512 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956520 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956526 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956534 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 21:45:15.956632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.956539 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 21:45:15.957446 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.957434 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 21:45:15.957479 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.957448 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 21:45:15.964097 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.964070 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 21:45:15.964208 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.964137 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 21:45:15.964208 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.964171 2565 server.go:1268] "Started kubelet" Jun 12 21:45:15.964298 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.964200 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 21:45:15.964298 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.964220 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 21:45:15.964298 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.964249 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 21:45:15.964451 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.964317 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 21:45:15.965119 ip-10-0-142-94 systemd[1]: Started Kubernetes Kubelet. Jun 12 21:45:15.966465 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.966452 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 12 21:45:15.966515 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.966457 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 21:45:15.968300 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.968264 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7cq5" Jun 12 21:45:15.971089 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.969937 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-94.ec2.internal.18b873903d31118e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-94.ec2.internal,UID:ip-10-0-142-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-94.ec2.internal,},FirstTimestamp:2026-06-12 21:45:15.964141966 +0000 UTC m=+0.406976332,LastTimestamp:2026-06-12 21:45:15.964141966 +0000 UTC m=+0.406976332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-94.ec2.internal,}" Jun 12 21:45:15.972237 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.972218 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 21:45:15.973025 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.973001 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 21:45:15.973025 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.973010 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 21:45:15.973142 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.973116 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:15.973777 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.973756 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 21:45:15.973908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.973890 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 21:45:15.973908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.973912 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 21:45:15.974057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974004 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 12 21:45:15.974057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974014 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 12 21:45:15.974155 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974083 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 21:45:15.974202 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974136 2565 factory.go:55] Registering systemd factory Jun 12 21:45:15.974301 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974239 2565 factory.go:223] Registration of the systemd container factory successfully Jun 12 21:45:15.974542 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974524 2565 factory.go:153] Registering CRI-O factory Jun 12 21:45:15.974612 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974548 2565 factory.go:223] Registration of the crio container factory successfully Jun 12 21:45:15.974612 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974574 2565 factory.go:103] Registering Raw factory Jun 12 21:45:15.974612 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.974592 2565 manager.go:1196] Started watching for new ooms in manager Jun 12 21:45:15.975808 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.975790 2565 manager.go:349] Starting recovery of all containers Jun 12 21:45:15.977374 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.977351 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 21:45:15.977516 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.977471 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 21:45:15.985775 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.985748 2565 manager.go:354] Recovery completed Jun 12 21:45:15.987384 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.987361 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7cq5" Jun 12 21:45:15.992194 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.992179 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:15.994223 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994207 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:15.994292 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994238 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:15.994292 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994251 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:15.994766 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994749 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 21:45:15.994766 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994762 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:15.994900 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994763 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 21:45:15.994900 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.994859 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:45:15.995428 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.995415 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:15.995478 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.995440 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:15.995478 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.995451 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:15.996458 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:15.996389 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-94.ec2.internal.18b873903efc103e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-94.ec2.internal,UID:ip-10-0-142-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-94.ec2.internal,},FirstTimestamp:2026-06-12 21:45:15.994222654 +0000 UTC m=+0.437057018,LastTimestamp:2026-06-12 21:45:15.994222654 +0000 UTC m=+0.437057018,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-94.ec2.internal,}" Jun 12 21:45:15.996849 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.996834 2565 policy_none.go:49] "None policy: Start" Jun 12 21:45:15.996905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.996855 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 21:45:15.996905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.996869 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 21:45:15.998881 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:15.998868 2565 policy_none.go:47] "Start" Jun 12 21:45:16.045440 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.045419 2565 manager.go:337] "Starting Device Plugin manager" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.045497 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.045511 2565 server.go:87] "Starting device plugin registration server" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.045796 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.045806 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.045916 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.046019 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.046031 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.047007 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.047054 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.056525 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.057893 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.057927 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.057950 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.058031 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 21:45:16.064427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.060487 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:16.146158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.146057 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:16.147142 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.147126 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:16.147209 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.147160 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:16.147209 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.147175 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:16.147209 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.147207 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.156057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.156041 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.156106 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.156065 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-94.ec2.internal\": node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.158361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.158343 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal"] Jun 12 21:45:16.158412 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.158402 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:16.160149 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.160130 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:16.160267 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.160165 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:16.160267 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.160179 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:16.162475 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.162460 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:16.162592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.162578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.162638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.162607 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:16.163267 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163247 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:16.163358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163282 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:16.163358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163250 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:16.163358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163294 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:16.163358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163311 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:16.163358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.163324 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:16.165547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.165532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.165598 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.165565 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:16.166283 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.166270 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:16.166354 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.166296 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:16.166354 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.166305 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:16.174813 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.174794 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.175798 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.175778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.175900 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.175802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.175900 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.175818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e800556701e0f3225594e9c8f5fee76a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-94.ec2.internal\" (UID: \"e800556701e0f3225594e9c8f5fee76a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.192606 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.192577 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-94.ec2.internal\" not found" node="ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.197081 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.197061 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-94.ec2.internal\" not found" node="ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.275300 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.275273 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.276406 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.276460 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.276460 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e800556701e0f3225594e9c8f5fee76a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-94.ec2.internal\" (UID: \"e800556701e0f3225594e9c8f5fee76a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.276553 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e800556701e0f3225594e9c8f5fee76a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-94.ec2.internal\" (UID: \"e800556701e0f3225594e9c8f5fee76a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.276553 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.276553 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.276537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18a6362046e50cbba1bdb8ef8cb3b303-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal\" (UID: \"18a6362046e50cbba1bdb8ef8cb3b303\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.376356 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.376324 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.477068 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.477007 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.496264 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.496240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.502463 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.502441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:16.577974 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.577931 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.678387 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.678364 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.779009 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.778933 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.879410 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.879372 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.901629 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.901601 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 21:45:16.901820 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.901772 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 21:45:16.914954 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.914921 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:16.980059 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:16.980031 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:16.994299 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.994264 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 21:40:15 +0000 UTC" deadline="2028-01-29 19:20:09.524589832 +0000 UTC" Jun 12 21:45:16.994299 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:16.994296 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14301h34m52.5302989s" Jun 12 21:45:17.025719 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:17.025536 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a6362046e50cbba1bdb8ef8cb3b303.slice/crio-13f7e7b65b905c7d6a9d1db49132f233b455e370ec438fa5bbdb106fbe3a8599 WatchSource:0}: Error finding container 13f7e7b65b905c7d6a9d1db49132f233b455e370ec438fa5bbdb106fbe3a8599: Status 404 returned error can't find the container with id 13f7e7b65b905c7d6a9d1db49132f233b455e370ec438fa5bbdb106fbe3a8599 Jun 12 21:45:17.026002 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:17.025975 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode800556701e0f3225594e9c8f5fee76a.slice/crio-862dbf6f11f3e97672a72c1c6e4b63c53036ec619f8d4dea9437524c5e179e2a WatchSource:0}: Error finding container 862dbf6f11f3e97672a72c1c6e4b63c53036ec619f8d4dea9437524c5e179e2a: Status 404 returned error can't find the container with id 862dbf6f11f3e97672a72c1c6e4b63c53036ec619f8d4dea9437524c5e179e2a Jun 12 21:45:17.032399 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.032375 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:45:17.061731 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.061655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" event={"ID":"e800556701e0f3225594e9c8f5fee76a","Type":"ContainerStarted","Data":"862dbf6f11f3e97672a72c1c6e4b63c53036ec619f8d4dea9437524c5e179e2a"} Jun 12 21:45:17.062844 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.062818 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" event={"ID":"18a6362046e50cbba1bdb8ef8cb3b303","Type":"ContainerStarted","Data":"13f7e7b65b905c7d6a9d1db49132f233b455e370ec438fa5bbdb106fbe3a8599"} Jun 12 21:45:17.080329 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.080302 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:17.084001 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.083987 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:17.181055 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.181013 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:17.281521 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.281433 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-94.ec2.internal\" not found" Jun 12 21:45:17.321032 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.321010 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:17.373979 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.373932 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" Jun 12 21:45:17.385981 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.385961 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:45:17.387591 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.387570 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" Jun 12 21:45:17.394614 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.394590 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:45:17.951001 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.950722 2565 apiserver.go:52] "Watching apiserver" Jun 12 21:45:17.964547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.964514 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 21:45:17.966117 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.966081 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-jdw86","kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal","openshift-multus/multus-additional-cni-plugins-kn597","openshift-multus/multus-wjjkg","openshift-multus/network-metrics-daemon-dpkvh","openshift-cluster-node-tuning-operator/tuned-zqf4x","openshift-dns/node-resolver-mmqqv","openshift-image-registry/node-ca-hk7t4","openshift-network-diagnostics/network-check-target-r589l","openshift-network-operator/iptables-alerter-lgvbw","openshift-ovn-kubernetes/ovnkube-node-mmkvf","kube-system/global-pull-secret-syncer-2vl6w"] Jun 12 21:45:17.968232 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.968204 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:17.970449 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.970423 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.970774 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.970755 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mzz89\"" Jun 12 21:45:17.971067 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.971048 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.971215 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.971192 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 21:45:17.971267 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.971195 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 21:45:17.972375 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.972357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.972962 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.972944 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 21:45:17.973758 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.973064 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 21:45:17.973758 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.973138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.973758 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.973435 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 21:45:17.973965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.973816 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 21:45:17.973965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.973823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 21:45:17.974062 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.974023 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5qt8m\"" Jun 12 21:45:17.974164 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.974144 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 21:45:17.974536 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.974517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:17.974642 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.974615 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:17.976732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.976711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:17.978797 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.978774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjjkg" Jun 12 21:45:17.980060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.980040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 21:45:17.980150 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.980132 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.980743 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.980724 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 21:45:17.980942 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.980923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8jj4g\"" Jun 12 21:45:17.981036 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.980970 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:17.981494 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.981477 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 21:45:17.981841 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.981823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.981924 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.981869 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fs98b\"" Jun 12 21:45:17.982115 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.982090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 21:45:17.982184 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.982160 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 21:45:17.982236 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.982226 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 21:45:17.982997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.982982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:17.983076 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.983047 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:17.984840 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.984823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 21:45:17.984986 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.984969 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l2brq\"" Jun 12 21:45:17.985281 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.985263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:17.985790 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.985771 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 21:45:17.986171 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-ovn\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986249 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-netd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986249 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8nz\" (UniqueName: \"kubernetes.io/projected/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kube-api-access-9t8nz\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.986249 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986249 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6stqs\"" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-systemd-units\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-sys-fs\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-netns\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-systemd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-etc-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-log-socket\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-config\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.986556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-kubelet-config\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-node-log\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-bin\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-socket-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-env-overrides\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ae3d0f7-5181-472c-ad6f-c567d61c4033-host\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-script-lib\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-registration-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-device-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ae3d0f7-5181-472c-ad6f-c567d61c4033-serviceca\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtlh\" (UniqueName: \"kubernetes.io/projected/9ae3d0f7-5181-472c-ad6f-c567d61c4033-kube-api-access-kvtlh\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.986990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-slash\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-var-lib-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-kubelet\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovn-node-metrics-cert\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8728\" (UniqueName: \"kubernetes.io/projected/f02a411a-46f3-4e19-bf2d-ec70999a6e63-kube-api-access-v8728\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:17.987561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.987228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-dbus\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:17.988236 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.988218 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:17.990502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.990483 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:17.990585 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:17.990553 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:17.992428 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.992407 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wd8b6\"" Jun 12 21:45:17.992957 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.992940 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:17.993123 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b6rr7\"" Jun 12 21:45:17.993258 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993244 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.993292 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993269 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 21:45:17.993794 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993519 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 21:45:17.993794 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 21:45:17.993794 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:17.993622 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:45:18.001361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.000962 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:45:18.001361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.000997 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 21:45:18.001361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.001011 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qw7kl\"" Jun 12 21:45:18.001539 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.001448 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 21:45:18.004215 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.004193 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:45:18.058783 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.058744 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-phj52" Jun 12 21:45:18.066131 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.066099 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-phj52" Jun 12 21:45:18.074892 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.074864 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 21:45:18.087473 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtlh\" (UniqueName: \"kubernetes.io/projected/9ae3d0f7-5181-472c-ad6f-c567d61c4033-kube-api-access-kvtlh\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.087473 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-slash\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-var-lib-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-slash\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-kubernetes\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-conf\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-var-lib-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.087763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8728\" (UniqueName: \"kubernetes.io/projected/f02a411a-46f3-4e19-bf2d-ec70999a6e63-kube-api-access-v8728\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-cnibin\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwq7\" (UniqueName: \"kubernetes.io/projected/b3d67cac-b704-4582-b443-202482c6d4f0-kube-api-access-6dwq7\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-tmp-dir\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef164fd1-1036-48e1-80aa-6508e44a1de8-iptables-alerter-script\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-ovn\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-netd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-ovn\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087989 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-netd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.087986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-kubelet\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9tl\" (UniqueName: \"kubernetes.io/projected/f8120340-2ad9-46d9-bf5e-102ecdc8884e-kube-api-access-xv9tl\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-modprobe-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-sys\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-systemd-units\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-hosts-file\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.088222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-konnectivity-ca\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-netns\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-systemd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-etc-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-netns\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-log-socket\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-systemd-units\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-log-socket\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-var-lib-kubelet\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-systemd\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-etc-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-socket-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-bin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-conf-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-run\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-env-overrides\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.088997 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cnibin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-multus\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-multus-certs\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-socket-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-etc-kubernetes\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-lib-modules\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ae3d0f7-5181-472c-ad6f-c567d61c4033-host\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-script-lib\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088629 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ae3d0f7-5181-472c-ad6f-c567d61c4033-host\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-registration-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-agent-certs\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ae3d0f7-5181-472c-ad6f-c567d61c4033-serviceca\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-hostroot\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-registration-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x79mx\" (UniqueName: \"kubernetes.io/projected/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-kube-api-access-x79mx\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-systemd\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-kubelet\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.089576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovn-node-metrics-cert\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-dbus\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-system-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-socket-dir-parent\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-netns\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfkl\" (UniqueName: \"kubernetes.io/projected/036e8279-fa8c-4107-812b-0c2fcf0df132-kube-api-access-wbfkl\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.088982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8nz\" (UniqueName: \"kubernetes.io/projected/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kube-api-access-9t8nz\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysconfig\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089037 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-env-overrides\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-kubelet\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzbx\" (UniqueName: \"kubernetes.io/projected/ef164fd1-1036-48e1-80aa-6508e44a1de8-kube-api-access-stzbx\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-sys-fs\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-system-cni-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.090274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-config\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-kubelet-config\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ae3d0f7-5181-472c-ad6f-c567d61c4033-serviceca\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-script-lib\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-os-release\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-sys-fs\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089311 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-os-release\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef164fd1-1036-48e1-80aa-6508e44a1de8-host-slash\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-node-log\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-bin\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovnkube-config\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.090828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cni-binary-copy\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-dbus\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfsl\" (UniqueName: \"kubernetes.io/projected/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-kube-api-access-mzfsl\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-run-openvswitch\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-daemon-config\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-node-log\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.089662 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d78fa06-b3ee-4f88-9688-11658e599c76-kubelet-config\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f02a411a-46f3-4e19-bf2d-ec70999a6e63-host-cni-bin\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.089745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:18.589724108 +0000 UTC m=+3.032558519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-tuned\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-device-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-k8s-cni-cncf-io\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-device-dir\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.091398 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-host\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.092011 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.089900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-tmp\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.092995 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.092976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f02a411a-46f3-4e19-bf2d-ec70999a6e63-ovn-node-metrics-cert\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.097527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.097504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtlh\" (UniqueName: \"kubernetes.io/projected/9ae3d0f7-5181-472c-ad6f-c567d61c4033-kube-api-access-kvtlh\") pod \"node-ca-hk7t4\" (UID: \"9ae3d0f7-5181-472c-ad6f-c567d61c4033\") " pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.097896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.097874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8728\" (UniqueName: \"kubernetes.io/projected/f02a411a-46f3-4e19-bf2d-ec70999a6e63-kube-api-access-v8728\") pod \"ovnkube-node-mmkvf\" (UID: \"f02a411a-46f3-4e19-bf2d-ec70999a6e63\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.098758 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.098736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8nz\" (UniqueName: \"kubernetes.io/projected/520f7ce3-e8f6-4663-8212-cb5bbb5e5878-kube-api-access-9t8nz\") pod \"aws-ebs-csi-driver-node-m2d7f\" (UID: \"520f7ce3-e8f6-4663-8212-cb5bbb5e5878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.153601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.153563 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:18.190424 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-cnibin\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.190424 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwq7\" (UniqueName: \"kubernetes.io/projected/b3d67cac-b704-4582-b443-202482c6d4f0-kube-api-access-6dwq7\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-tmp-dir\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef164fd1-1036-48e1-80aa-6508e44a1de8-iptables-alerter-script\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-cnibin\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-kubelet\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9tl\" (UniqueName: \"kubernetes.io/projected/f8120340-2ad9-46d9-bf5e-102ecdc8884e-kube-api-access-xv9tl\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-modprobe-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.190663 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-sys\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-modprobe-d\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-tmp-dir\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-hosts-file\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-konnectivity-ca\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-kubelet\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-var-lib-kubelet\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-hosts-file\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-bin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-sys\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-var-lib-kubelet\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.190979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-conf-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.191039 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-conf-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-run\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.191116 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:18.691097938 +0000 UTC m=+3.133932294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:18.191141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-bin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191155 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-run\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cnibin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cnibin\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef164fd1-1036-48e1-80aa-6508e44a1de8-iptables-alerter-script\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-multus\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-multus-certs\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-etc-kubernetes\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-var-lib-cni-multus\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-lib-modules\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-multus-certs\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-etc-kubernetes\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-agent-certs\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-hostroot\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x79mx\" (UniqueName: \"kubernetes.io/projected/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-kube-api-access-x79mx\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-lib-modules\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-konnectivity-ca\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-systemd\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.191968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-hostroot\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-system-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-systemd\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-socket-dir-parent\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-netns\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191558 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-socket-dir-parent\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-system-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfkl\" (UniqueName: \"kubernetes.io/projected/036e8279-fa8c-4107-812b-0c2fcf0df132-kube-api-access-wbfkl\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-netns\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysconfig\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stzbx\" (UniqueName: \"kubernetes.io/projected/ef164fd1-1036-48e1-80aa-6508e44a1de8-kube-api-access-stzbx\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-system-cni-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysconfig\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-os-release\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.192817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-os-release\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef164fd1-1036-48e1-80aa-6508e44a1de8-host-slash\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cni-binary-copy\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-os-release\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfsl\" (UniqueName: \"kubernetes.io/projected/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-kube-api-access-mzfsl\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-daemon-config\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-system-cni-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-tuned\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-os-release\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.191989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-k8s-cni-cncf-io\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-host\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-tmp\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-kubernetes\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-conf\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.193293 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-host\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-cni-binary-copy\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3d67cac-b704-4582-b443-202482c6d4f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-daemon-config\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-multus-cni-dir\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef164fd1-1036-48e1-80aa-6508e44a1de8-host-slash\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-sysctl-conf\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3d67cac-b704-4582-b443-202482c6d4f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f8120340-2ad9-46d9-bf5e-102ecdc8884e-host-run-k8s-cni-cncf-io\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.194018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.192647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-kubernetes\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.194446 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.194041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/07fe700f-fe90-4a7b-b29a-a5a34ff547ef-agent-certs\") pod \"konnectivity-agent-jdw86\" (UID: \"07fe700f-fe90-4a7b-b29a-a5a34ff547ef\") " pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.194565 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.194546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-tmp\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.194659 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.194641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/036e8279-fa8c-4107-812b-0c2fcf0df132-etc-tuned\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.202719 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.202589 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:18.202719 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.202612 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:18.202719 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.202622 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:18.202719 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.202709 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:18.702676524 +0000 UTC m=+3.145510876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:18.206268 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.206237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwq7\" (UniqueName: \"kubernetes.io/projected/b3d67cac-b704-4582-b443-202482c6d4f0-kube-api-access-6dwq7\") pod \"multus-additional-cni-plugins-kn597\" (UID: \"b3d67cac-b704-4582-b443-202482c6d4f0\") " pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.206492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.206468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x79mx\" (UniqueName: \"kubernetes.io/projected/5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a-kube-api-access-x79mx\") pod \"node-resolver-mmqqv\" (UID: \"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a\") " pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.208504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.206651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9tl\" (UniqueName: \"kubernetes.io/projected/f8120340-2ad9-46d9-bf5e-102ecdc8884e-kube-api-access-xv9tl\") pod \"multus-wjjkg\" (UID: \"f8120340-2ad9-46d9-bf5e-102ecdc8884e\") " pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.208504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.206936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfkl\" (UniqueName: \"kubernetes.io/projected/036e8279-fa8c-4107-812b-0c2fcf0df132-kube-api-access-wbfkl\") pod \"tuned-zqf4x\" (UID: \"036e8279-fa8c-4107-812b-0c2fcf0df132\") " pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.209149 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.209128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfsl\" (UniqueName: \"kubernetes.io/projected/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-kube-api-access-mzfsl\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.209924 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.209902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzbx\" (UniqueName: \"kubernetes.io/projected/ef164fd1-1036-48e1-80aa-6508e44a1de8-kube-api-access-stzbx\") pod \"iptables-alerter-lgvbw\" (UID: \"ef164fd1-1036-48e1-80aa-6508e44a1de8\") " pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.281561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.281525 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hk7t4" Jun 12 21:45:18.289871 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.289844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:18.296634 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.296608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" Jun 12 21:45:18.302993 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.302966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn597" Jun 12 21:45:18.309928 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.309905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjjkg" Jun 12 21:45:18.317679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.317649 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmqqv" Jun 12 21:45:18.324444 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.324424 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" Jun 12 21:45:18.330112 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.330092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:18.336704 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.336668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgvbw" Jun 12 21:45:18.595934 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.595847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:18.596069 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.595992 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:18.596069 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.596056 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:19.596041771 +0000 UTC m=+4.038876129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:18.696895 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.696862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:18.697058 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.697000 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:18.697102 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.697063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:19.697049274 +0000 UTC m=+4.139883625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:18.797733 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:18.797668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:18.797892 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.797832 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:18.797892 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.797858 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:18.797892 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.797869 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:18.798055 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:18.797924 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:19.797909228 +0000 UTC m=+4.240743581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:18.882353 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.882321 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fe700f_fe90_4a7b_b29a_a5a34ff547ef.slice/crio-92b357ddd47539cbb39d57c302b1d90db6014b31d90a71b3239fb26809ce705b WatchSource:0}: Error finding container 92b357ddd47539cbb39d57c302b1d90db6014b31d90a71b3239fb26809ce705b: Status 404 returned error can't find the container with id 92b357ddd47539cbb39d57c302b1d90db6014b31d90a71b3239fb26809ce705b Jun 12 21:45:18.883636 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.883561 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d67cac_b704_4582_b443_202482c6d4f0.slice/crio-922e3b7c5f661de09a98b312566c856762a9580e78c2c90ea993ae7d1e5b602b WatchSource:0}: Error finding container 922e3b7c5f661de09a98b312566c856762a9580e78c2c90ea993ae7d1e5b602b: Status 404 returned error can't find the container with id 922e3b7c5f661de09a98b312566c856762a9580e78c2c90ea993ae7d1e5b602b Jun 12 21:45:18.884944 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.884918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feaa91f_7d1c_4c1b_9925_6ff6fddfd98a.slice/crio-8da125ae55e3bec73dd5df66ea9a0c5add4d75bcfee4de202912db5a444f45f2 WatchSource:0}: Error finding container 8da125ae55e3bec73dd5df66ea9a0c5add4d75bcfee4de202912db5a444f45f2: Status 404 returned error can't find the container with id 8da125ae55e3bec73dd5df66ea9a0c5add4d75bcfee4de202912db5a444f45f2 Jun 12 21:45:18.907978 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.907950 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02a411a_46f3_4e19_bf2d_ec70999a6e63.slice/crio-07af5c354eb96085649afea397a2f647331267d7f08c6fd90030bb1815f2d9c3 WatchSource:0}: Error finding container 07af5c354eb96085649afea397a2f647331267d7f08c6fd90030bb1815f2d9c3: Status 404 returned error can't find the container with id 07af5c354eb96085649afea397a2f647331267d7f08c6fd90030bb1815f2d9c3 Jun 12 21:45:18.908979 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.908945 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8120340_2ad9_46d9_bf5e_102ecdc8884e.slice/crio-f8023babc9de5d29d5e2e1e39eb27a01e51019453cf01a1e7dfa90b2f6382066 WatchSource:0}: Error finding container f8023babc9de5d29d5e2e1e39eb27a01e51019453cf01a1e7dfa90b2f6382066: Status 404 returned error can't find the container with id f8023babc9de5d29d5e2e1e39eb27a01e51019453cf01a1e7dfa90b2f6382066 Jun 12 21:45:18.915198 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.915170 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036e8279_fa8c_4107_812b_0c2fcf0df132.slice/crio-1ab72cb6bf45cfaec7bcdb8f56e78ec193ea57a655c4088e2bd7883cc28348ba WatchSource:0}: Error finding container 1ab72cb6bf45cfaec7bcdb8f56e78ec193ea57a655c4088e2bd7883cc28348ba: Status 404 returned error can't find the container with id 1ab72cb6bf45cfaec7bcdb8f56e78ec193ea57a655c4088e2bd7883cc28348ba Jun 12 21:45:18.915924 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.915796 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae3d0f7_5181_472c_ad6f_c567d61c4033.slice/crio-a3aaa1a9014d6b05e9c07cf9c9a14b24af099d43200dc4a74f1391ff83ceba85 WatchSource:0}: Error finding container a3aaa1a9014d6b05e9c07cf9c9a14b24af099d43200dc4a74f1391ff83ceba85: Status 404 returned error can't find the container with id a3aaa1a9014d6b05e9c07cf9c9a14b24af099d43200dc4a74f1391ff83ceba85 Jun 12 21:45:18.916922 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.916896 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef164fd1_1036_48e1_80aa_6508e44a1de8.slice/crio-b287323ab88daa430cba2410ff7d2f93c2bfdf2593a174f4131f2570327afe91 WatchSource:0}: Error finding container b287323ab88daa430cba2410ff7d2f93c2bfdf2593a174f4131f2570327afe91: Status 404 returned error can't find the container with id b287323ab88daa430cba2410ff7d2f93c2bfdf2593a174f4131f2570327afe91 Jun 12 21:45:18.918237 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:45:18.917991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520f7ce3_e8f6_4663_8212_cb5bbb5e5878.slice/crio-227b7e7c51824f8994d6bc1fe4e8f2f52e5b38beda398b0fdd083087b1266455 WatchSource:0}: Error finding container 227b7e7c51824f8994d6bc1fe4e8f2f52e5b38beda398b0fdd083087b1266455: Status 404 returned error can't find the container with id 227b7e7c51824f8994d6bc1fe4e8f2f52e5b38beda398b0fdd083087b1266455 Jun 12 21:45:19.069349 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.069306 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:40:18 +0000 UTC" deadline="2028-01-13 23:03:13.58494361 +0000 UTC" Jun 12 21:45:19.069349 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.069344 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13921h17m54.515605004s" Jun 12 21:45:19.070677 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.070651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hk7t4" event={"ID":"9ae3d0f7-5181-472c-ad6f-c567d61c4033","Type":"ContainerStarted","Data":"a3aaa1a9014d6b05e9c07cf9c9a14b24af099d43200dc4a74f1391ff83ceba85"} Jun 12 21:45:19.072614 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.072557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" event={"ID":"036e8279-fa8c-4107-812b-0c2fcf0df132","Type":"ContainerStarted","Data":"1ab72cb6bf45cfaec7bcdb8f56e78ec193ea57a655c4088e2bd7883cc28348ba"} Jun 12 21:45:19.073619 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.073593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmqqv" event={"ID":"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a","Type":"ContainerStarted","Data":"8da125ae55e3bec73dd5df66ea9a0c5add4d75bcfee4de202912db5a444f45f2"} Jun 12 21:45:19.076008 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.075984 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdw86" event={"ID":"07fe700f-fe90-4a7b-b29a-a5a34ff547ef","Type":"ContainerStarted","Data":"92b357ddd47539cbb39d57c302b1d90db6014b31d90a71b3239fb26809ce705b"} Jun 12 21:45:19.078367 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.078343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" event={"ID":"e800556701e0f3225594e9c8f5fee76a","Type":"ContainerStarted","Data":"08349e9e9799a5276b9e34770efe8180bb304f1d5380af5150a0a71ecbc7c8a9"} Jun 12 21:45:19.081411 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.081365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" event={"ID":"520f7ce3-e8f6-4663-8212-cb5bbb5e5878","Type":"ContainerStarted","Data":"227b7e7c51824f8994d6bc1fe4e8f2f52e5b38beda398b0fdd083087b1266455"} Jun 12 21:45:19.082823 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.082800 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgvbw" event={"ID":"ef164fd1-1036-48e1-80aa-6508e44a1de8","Type":"ContainerStarted","Data":"b287323ab88daa430cba2410ff7d2f93c2bfdf2593a174f4131f2570327afe91"} Jun 12 21:45:19.084120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.084096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjjkg" event={"ID":"f8120340-2ad9-46d9-bf5e-102ecdc8884e","Type":"ContainerStarted","Data":"f8023babc9de5d29d5e2e1e39eb27a01e51019453cf01a1e7dfa90b2f6382066"} Jun 12 21:45:19.085592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.085561 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"07af5c354eb96085649afea397a2f647331267d7f08c6fd90030bb1815f2d9c3"} Jun 12 21:45:19.086778 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.086755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerStarted","Data":"922e3b7c5f661de09a98b312566c856762a9580e78c2c90ea993ae7d1e5b602b"} Jun 12 21:45:19.091598 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.091549 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-94.ec2.internal" podStartSLOduration=2.091537289 podStartE2EDuration="2.091537289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:19.09130691 +0000 UTC m=+3.534141283" watchObservedRunningTime="2026-06-12 21:45:19.091537289 +0000 UTC m=+3.534371662" Jun 12 21:45:19.605256 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.605159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:19.605452 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.605331 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:19.605452 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.605397 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:21.605378985 +0000 UTC m=+6.048213340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:19.705949 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.705907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:19.706121 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.706088 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:19.706172 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.706152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:21.706134114 +0000 UTC m=+6.148968471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:19.807477 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:19.806840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:19.807477 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.807040 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:19.807477 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.807062 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:19.807477 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.807074 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:19.807477 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:19.807135 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:21.807115517 +0000 UTC m=+6.249949873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.059209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:20.059339 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.059779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:20.059877 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.059966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:20.060166 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:20.060062 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:20.069791 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.069739 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:40:18 +0000 UTC" deadline="2027-11-23 01:21:31.205228513 +0000 UTC" Jun 12 21:45:20.069791 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.069769 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12675h36m11.135463584s" Jun 12 21:45:20.106732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.106251 2565 generic.go:356] "Generic (PLEG): container finished" podID="18a6362046e50cbba1bdb8ef8cb3b303" containerID="95e342351b74dc1f61376c2bbc41f6c58d5f5f882bd8de6803c919d2edff2efb" exitCode=0 Jun 12 21:45:20.106732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:20.106344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" event={"ID":"18a6362046e50cbba1bdb8ef8cb3b303","Type":"ContainerDied","Data":"95e342351b74dc1f61376c2bbc41f6c58d5f5f882bd8de6803c919d2edff2efb"} Jun 12 21:45:21.138188 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:21.138145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" event={"ID":"18a6362046e50cbba1bdb8ef8cb3b303","Type":"ContainerStarted","Data":"ca963ccb62d80a830bd99dd7eb93fe37b1db55a077d8f467ec84b7699bdab716"} Jun 12 21:45:21.625746 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:21.625073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:21.625746 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.625236 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:21.625746 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.625303 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:25.625284662 +0000 UTC m=+10.068119020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:21.725807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:21.725768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:21.725987 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.725971 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:21.726049 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.726035 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:25.726016165 +0000 UTC m=+10.168850520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:21.826573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:21.826532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:21.826789 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.826725 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:21.826789 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.826747 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:21.826789 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.826760 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:21.826949 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:21.826820 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:25.826802631 +0000 UTC m=+10.269636989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:22.059004 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:22.058874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:22.059004 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:22.058894 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:22.059004 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:22.058894 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:22.059258 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:22.059017 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:22.059258 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:22.059146 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:22.059258 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:22.059245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:24.061177 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:24.061192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:24.061320 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:24.061388 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:24.061435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:24.061739 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:24.061492 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:25.660550 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:25.660517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:25.661036 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.660729 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:25.661036 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.660790 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:33.660772076 +0000 UTC m=+18.103606434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:25.762889 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:25.762853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:25.763093 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.763022 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:25.763093 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.763084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:33.763071144 +0000 UTC m=+18.205905495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:25.864354 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:25.864276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:25.864533 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.864475 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:25.864533 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.864499 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:25.864533 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.864514 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:25.864668 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:25.864580 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:33.864560059 +0000 UTC m=+18.307394425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:26.059978 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:26.059902 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:26.060141 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:26.060015 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:26.060438 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:26.060415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:26.060534 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:26.060515 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:26.060587 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:26.060579 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:26.060712 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:26.060676 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:28.058630 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:28.058592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:28.059072 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:28.058750 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:28.059072 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:28.058592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:28.059072 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:28.058892 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:28.059072 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:28.058945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:28.059072 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:28.059045 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:30.058380 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:30.058339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:30.058859 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:30.058339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:30.058859 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:30.058339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:30.058859 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:30.058519 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:30.058859 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:30.058587 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:30.058859 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:30.058636 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:32.058970 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:32.058776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:32.059416 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:32.058776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:32.059416 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:32.059091 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:32.059416 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:32.058776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:32.059416 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:32.059165 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:32.059416 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:32.059212 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:33.725855 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:33.725807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:33.726318 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.725938 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:33.726318 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.726012 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:49.725992108 +0000 UTC m=+34.168826470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:33.826408 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:33.826363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:33.826585 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.826537 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:33.826627 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.826609 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:45:49.826591024 +0000 UTC m=+34.269425380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:33.927338 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:33.927302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:33.927506 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.927483 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:33.927577 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.927514 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:33.927577 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.927524 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:33.927665 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:33.927590 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:49.927575246 +0000 UTC m=+34.370409598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:34.058846 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:34.058756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:34.058994 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:34.058756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:34.058994 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:34.058905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:34.058994 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:34.058903 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:34.059189 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:34.059003 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:34.059189 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:34.059088 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:36.059524 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:36.059492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:36.060030 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:36.059603 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:36.060030 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:36.059644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:36.060030 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:36.059802 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:36.060030 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:36.059857 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:36.060030 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:36.059925 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:38.058403 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.058163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:38.059066 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.058184 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:38.059066 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:38.058450 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:38.059066 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.058250 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:38.059066 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:38.058530 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:38.059066 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:38.058600 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:38.177196 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.177162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" event={"ID":"520f7ce3-e8f6-4663-8212-cb5bbb5e5878","Type":"ContainerStarted","Data":"f02d99bd6237f3a0a9cfa1e88cc0f570c65ae9948e148f5049104f09baecf367"} Jun 12 21:45:38.178822 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.178790 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjjkg" event={"ID":"f8120340-2ad9-46d9-bf5e-102ecdc8884e","Type":"ContainerStarted","Data":"e191217fc6e580187efee3473fb45a1d87f7ba4097f8358dd68bd94e1f7345f1"} Jun 12 21:45:38.181079 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.181059 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:45:38.181445 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.181415 2565 generic.go:356] "Generic (PLEG): container finished" podID="f02a411a-46f3-4e19-bf2d-ec70999a6e63" containerID="3e54b5b00378e720ec8bc4eb440f3af01be02bd49e0212156da0c560643982fa" exitCode=1 Jun 12 21:45:38.181564 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.181491 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"eedffced61308fd3fcf6e92b21787042d643e5ffe718e0dac598698b75e62dd0"} Jun 12 21:45:38.181564 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.181551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerDied","Data":"3e54b5b00378e720ec8bc4eb440f3af01be02bd49e0212156da0c560643982fa"} Jun 12 21:45:38.181679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.181605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"95eceee347355c74f5a4c3e3e9b68136796e71732869974b1d6c1df2c5f1f60d"} Jun 12 21:45:38.183119 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.183096 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="623aa0abd014dc29c539cba2fd5ca79a7dfded882ac021c740c6e124cde62e7c" exitCode=0 Jun 12 21:45:38.183222 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.183163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"623aa0abd014dc29c539cba2fd5ca79a7dfded882ac021c740c6e124cde62e7c"} Jun 12 21:45:38.184817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.184786 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hk7t4" event={"ID":"9ae3d0f7-5181-472c-ad6f-c567d61c4033","Type":"ContainerStarted","Data":"bed409f60fd2eda7c99c1a85c2c28cd5170daf8c8d456ae700257577cbdf3475"} Jun 12 21:45:38.189795 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.189766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" event={"ID":"036e8279-fa8c-4107-812b-0c2fcf0df132","Type":"ContainerStarted","Data":"d82b38d59c42c6fff2d7ff058d4a3600525e3632abd41848c3f0299873a36e4a"} Jun 12 21:45:38.192059 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.192036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmqqv" event={"ID":"5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a","Type":"ContainerStarted","Data":"70ee85ba0c78d5e0100beb281d38fa7ff5d2669ab0e757a28059d3ce4678e247"} Jun 12 21:45:38.193354 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.193328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdw86" event={"ID":"07fe700f-fe90-4a7b-b29a-a5a34ff547ef","Type":"ContainerStarted","Data":"6bc3b64d081c6cece8c9660870f36faf5273b6344dff205bc0792cdcb1f04003"} Jun 12 21:45:38.197405 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.197358 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-94.ec2.internal" podStartSLOduration=21.19734313 podStartE2EDuration="21.19734313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:21.15945216 +0000 UTC m=+5.602286535" watchObservedRunningTime="2026-06-12 21:45:38.19734313 +0000 UTC m=+22.640177506" Jun 12 21:45:38.197522 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.197492 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wjjkg" podStartSLOduration=3.390406956 podStartE2EDuration="22.197486757s" totalImagesPullingTime="18.807079801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:38.196876396 +0000 UTC m=+22.639710782" watchObservedRunningTime="2026-06-12 21:45:38.197486757 +0000 UTC m=+22.640321131" Jun 12 21:45:38.210455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.210397 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jdw86" podStartSLOduration=7.972153042 podStartE2EDuration="22.210384241s" totalImagesPullingTime="14.238231199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:38.210187497 +0000 UTC m=+22.653021870" watchObservedRunningTime="2026-06-12 21:45:38.210384241 +0000 UTC m=+22.653218614" Jun 12 21:45:38.224001 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.223946 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mmqqv" podStartSLOduration=3.467952078 podStartE2EDuration="22.223932056s" totalImagesPullingTime="18.755979978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:38.223363505 +0000 UTC m=+22.666197879" watchObservedRunningTime="2026-06-12 21:45:38.223932056 +0000 UTC m=+22.666766429" Jun 12 21:45:38.238560 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.238520 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqf4x" podStartSLOduration=3.474842115 podStartE2EDuration="22.238501575s" totalImagesPullingTime="18.76365946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:38.238261035 +0000 UTC m=+22.681095409" watchObservedRunningTime="2026-06-12 21:45:38.238501575 +0000 UTC m=+22.681335948" Jun 12 21:45:38.252451 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:38.252411 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hk7t4" podStartSLOduration=3.491027884 podStartE2EDuration="22.252397688s" totalImagesPullingTime="18.761369804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:38.252014813 +0000 UTC m=+22.694849186" watchObservedRunningTime="2026-06-12 21:45:38.252397688 +0000 UTC m=+22.695232062" Jun 12 21:45:39.172365 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.172341 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 21:45:39.198163 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.198122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" event={"ID":"520f7ce3-e8f6-4663-8212-cb5bbb5e5878","Type":"ContainerStarted","Data":"68bb1f6663c4aaa7c798815da7f870c16da227db3cabfc45d715563f24235e16"} Jun 12 21:45:39.199722 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.199676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgvbw" event={"ID":"ef164fd1-1036-48e1-80aa-6508e44a1de8","Type":"ContainerStarted","Data":"aaaff13c9ac227807dfd1700a27aee2260caa592e9296cf056b28312d2808e63"} Jun 12 21:45:39.203150 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.203123 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:45:39.203740 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.203716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"cc3c38db0f2cd460b87c1b4e98f79d8c0745b53f4e4083e5c4f5c8bf2d787bd9"} Jun 12 21:45:39.203838 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.203806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"fa7eaf4866560ebb5cfb2f049176c026367da41335bae92023abbcae72e2376e"} Jun 12 21:45:39.203903 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.203877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"0eb4c0ade029348b1f92958ba73addefde3878b8fea5dc9733ffc1468e1977fe"} Jun 12 21:45:39.216242 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:39.216186 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lgvbw" podStartSLOduration=4.454520249 podStartE2EDuration="23.216170481s" totalImagesPullingTime="18.761650232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:39.216124815 +0000 UTC m=+23.658959190" watchObservedRunningTime="2026-06-12 21:45:39.216170481 +0000 UTC m=+23.659004855" Jun 12 21:45:40.058927 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.058818 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T21:45:39.172360743Z","UUID":"66a8b526-69bf-4a01-85b2-7e3960263086","Handler":null,"Name":"","Endpoint":""} Jun 12 21:45:40.059090 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.058988 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:40.059090 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.058986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:40.059169 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:40.059112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:40.059230 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:40.059207 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:40.059271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.059247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:40.059347 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:40.059317 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:40.060610 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.060586 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 21:45:40.060756 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.060642 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 21:45:40.208647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.207972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" event={"ID":"520f7ce3-e8f6-4663-8212-cb5bbb5e5878","Type":"ContainerStarted","Data":"4428b69d9f556d165106b14f1ba3bad1a9f1e2b09f591fa57df0f8b1eddc07c4"} Jun 12 21:45:40.225841 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.225781 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2d7f" podStartSLOduration=3.609527716 podStartE2EDuration="24.225762677s" totalImagesPullingTime="20.616234961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:40.225431768 +0000 UTC m=+24.668266143" watchObservedRunningTime="2026-06-12 21:45:40.225762677 +0000 UTC m=+24.668597052" Jun 12 21:45:40.707732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:40.707682 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:41.022215 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.022162 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:41.022844 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.022817 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:41.214295 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.214261 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:45:41.214836 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.214716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"28d8401df8a94a0a8b5ff2195f68458085ed8364e6a68bf6c1e62ba0d838f083"} Jun 12 21:45:41.215447 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.215426 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jdw86" Jun 12 21:45:41.345271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:41.345188 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mmqqv_5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a/dns-node-resolver/0.log" Jun 12 21:45:42.058320 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:42.058281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:42.058507 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:42.058401 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:42.058507 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:42.058413 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:42.058626 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:42.058535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:42.058626 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:42.058595 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:42.058626 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:42.058530 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:42.120431 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:42.120398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hk7t4_9ae3d0f7-5181-472c-ad6f-c567d61c4033/node-ca/0.log" Jun 12 21:45:43.223263 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.223091 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:45:43.223974 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.223616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"63d60ec63634b531ca2631d7a092a24b68294e951c2ae2c81706a741b4d2559c"} Jun 12 21:45:43.223974 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.223858 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:43.226804 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.224489 2565 scope.go:117] "RemoveContainer" containerID="3e54b5b00378e720ec8bc4eb440f3af01be02bd49e0212156da0c560643982fa" Jun 12 21:45:43.228720 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.228675 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="3f2e504c16370849cca5db8d99d0893a5810a0853677b3682cf492086bdecce1" exitCode=0 Jun 12 21:45:43.228824 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.228728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"3f2e504c16370849cca5db8d99d0893a5810a0853677b3682cf492086bdecce1"} Jun 12 21:45:43.247797 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:43.247775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:44.058775 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.058745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:44.058946 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.058745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:44.058946 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:44.058853 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:44.058946 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.058865 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:44.059054 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:44.058941 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:44.059054 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:44.059028 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:44.234615 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.234535 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:45:44.235008 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.234978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" event={"ID":"f02a411a-46f3-4e19-bf2d-ec70999a6e63","Type":"ContainerStarted","Data":"a2ccb3a6b18a7b062e627941266c2cd05f039536f44b658a65d135451204c44b"} Jun 12 21:45:44.235064 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.235049 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 21:45:44.235399 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.235372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:44.237302 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.237266 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="ff280b569ca6bb1dfa0d734e941d135b4204e0c001f0446915a7bcde239f7c04" exitCode=0 Jun 12 21:45:44.237404 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.237311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"ff280b569ca6bb1dfa0d734e941d135b4204e0c001f0446915a7bcde239f7c04"} Jun 12 21:45:44.252704 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.252655 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:44.277207 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:44.275164 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" podStartSLOduration=9.429768846 podStartE2EDuration="28.275144841s" totalImagesPullingTime="18.845375995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:44.274999068 +0000 UTC m=+28.717833438" watchObservedRunningTime="2026-06-12 21:45:44.275144841 +0000 UTC m=+28.717979234" Jun 12 21:45:45.241419 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:45.241384 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="c03f48ac8d87d16cca8af3b51e25a751e13e40c314bcfcc3983b7906b7d6c496" exitCode=0 Jun 12 21:45:45.241908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:45.241482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"c03f48ac8d87d16cca8af3b51e25a751e13e40c314bcfcc3983b7906b7d6c496"} Jun 12 21:45:45.241908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:45.241559 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 21:45:45.474131 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:45.473941 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:45:46.062379 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:46.062354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:46.062543 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:46.062354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:46.062543 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:46.062464 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:46.062543 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:46.062520 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:46.062543 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:46.062354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:46.062754 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:46.062596 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:47.259670 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:47.259618 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" podUID="f02a411a-46f3-4e19-bf2d-ec70999a6e63" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 21:45:48.058846 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:48.058809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:48.059049 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:48.058809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:48.059049 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:48.058935 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:48.059049 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:48.058809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:48.059049 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:48.059017 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:48.059232 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:48.059105 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:49.738421 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:49.738385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:49.738943 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.738515 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:49.738943 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.738575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret podName:3d78fa06-b3ee-4f88-9688-11658e599c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:21.738557327 +0000 UTC m=+66.181391680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret") pod "global-pull-secret-syncer-2vl6w" (UID: "3d78fa06-b3ee-4f88-9688-11658e599c76") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:49.839768 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:49.839733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:49.839936 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.839850 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:49.839936 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.839903 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs podName:c5ad33cd-6c59-4344-ab98-0c3ef62f6afa nodeName:}" failed. No retries permitted until 2026-06-12 21:46:21.839889261 +0000 UTC m=+66.282723613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs") pod "network-metrics-daemon-dpkvh" (UID: "c5ad33cd-6c59-4344-ab98-0c3ef62f6afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:49.940535 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:49.940500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:49.940742 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.940635 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:49.940742 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.940650 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:49.940742 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.940659 2565 projected.go:196] Error preparing data for projected volume kube-api-access-v5qv5 for pod openshift-network-diagnostics/network-check-target-r589l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:49.940742 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:49.940724 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5 podName:8367357f-b514-4eee-ae82-89900322a1a6 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:21.940712638 +0000 UTC m=+66.383546991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5qv5" (UniqueName: "kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5") pod "network-check-target-r589l" (UID: "8367357f-b514-4eee-ae82-89900322a1a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:50.061805 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:50.061734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:50.061941 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:50.061826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:50.061941 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:50.061830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:50.061941 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:50.061911 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:50.062033 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:50.061828 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:50.062033 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:50.061985 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:50.256814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:50.256780 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="d53c13d01d76d7c04a7a241df81c43a6987e5a2c9ed4aedef9a8173bc05548ae" exitCode=0 Jun 12 21:45:50.256962 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:50.256819 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"d53c13d01d76d7c04a7a241df81c43a6987e5a2c9ed4aedef9a8173bc05548ae"} Jun 12 21:45:51.261938 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:51.261906 2565 generic.go:356] "Generic (PLEG): container finished" podID="b3d67cac-b704-4582-b443-202482c6d4f0" containerID="c24be46fffaafa46cbf640e430d2cb94d3ef9783124bc1c78348a97fc301ffa8" exitCode=0 Jun 12 21:45:51.262400 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:51.261951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerDied","Data":"c24be46fffaafa46cbf640e430d2cb94d3ef9783124bc1c78348a97fc301ffa8"} Jun 12 21:45:52.061460 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:52.061427 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:52.061641 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:52.061516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:52.061641 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:52.061537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:52.061641 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:52.061611 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:52.061801 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:52.061718 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:52.061801 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:52.061768 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:52.267475 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:52.267438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn597" event={"ID":"b3d67cac-b704-4582-b443-202482c6d4f0","Type":"ContainerStarted","Data":"b8180451f1cf335f1713436faefb4859abf4b94003d39ad88e5ba493418af1b1"} Jun 12 21:45:52.293107 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:52.293054 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kn597" podStartSLOduration=8.236154978 podStartE2EDuration="36.293039196s" totalImagesPullingTime="28.056884218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:52.292853806 +0000 UTC m=+36.735688179" watchObservedRunningTime="2026-06-12 21:45:52.293039196 +0000 UTC m=+36.735873569" Jun 12 21:45:54.058418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:54.058379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:54.058993 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:54.058386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:54.058993 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:54.058492 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:54.058993 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:54.058586 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:54.058993 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:54.058386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:54.058993 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:54.058706 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:56.059092 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:56.059061 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:56.059550 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:56.059154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:56.059550 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:56.059159 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:56.059550 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:56.059251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:56.059550 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:56.059313 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:45:56.059550 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:56.059250 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:58.059230 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:58.059195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:45:58.059230 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:58.059216 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:45:58.059646 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:58.059308 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:45:58.059646 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:58.059366 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:45:58.059646 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:45:58.059396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:45:58.059646 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:45:58.059462 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:46:00.058809 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:00.058773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:00.059252 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:00.058787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:00.059252 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:00.058887 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:46:00.059252 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:00.058986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:00.059252 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:00.058985 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:46:00.059252 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:00.059069 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:46:01.684827 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.684572 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2vl6w"] Jun 12 21:46:01.685269 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.684930 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:01.685269 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:01.685035 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:46:01.688361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.688332 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpkvh"] Jun 12 21:46:01.688497 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.688463 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:01.688612 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:01.688588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:46:01.689129 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.689108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r589l"] Jun 12 21:46:01.689213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:01.689201 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:01.689329 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:01.689297 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:46:03.058899 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:03.058816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:03.059270 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:03.058909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:03.059270 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:03.058915 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:46:03.059270 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:03.058937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:03.059270 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:03.059001 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:46:03.059270 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:03.059066 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:46:05.058506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:05.058470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:05.058931 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:05.058470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:05.058931 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:05.058580 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r589l" podUID="8367357f-b514-4eee-ae82-89900322a1a6" Jun 12 21:46:05.058931 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:05.058473 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:05.058931 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:05.058661 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vl6w" podUID="3d78fa06-b3ee-4f88-9688-11658e599c76" Jun 12 21:46:05.058931 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:05.058781 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpkvh" podUID="c5ad33cd-6c59-4344-ab98-0c3ef62f6afa" Jun 12 21:46:06.808905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.808875 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-94.ec2.internal" event="NodeReady" Jun 12 21:46:06.809413 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.809019 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 21:46:06.862519 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.862485 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tfkt4"] Jun 12 21:46:06.885149 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.885123 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbfcp"] Jun 12 21:46:06.885289 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.885241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:06.888405 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.888381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 21:46:06.889845 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.889826 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gfb7z\"" Jun 12 21:46:06.889957 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.889860 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 21:46:06.890210 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.890196 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 21:46:06.907205 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.907180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfkt4"] Jun 12 21:46:06.907205 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.907213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbfcp"] Jun 12 21:46:06.907413 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.907248 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-74nrc"] Jun 12 21:46:06.907413 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.907309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.909905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.909882 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 21:46:06.910041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.909906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8r887\"" Jun 12 21:46:06.910041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.909930 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 21:46:06.910041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.909953 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 21:46:06.910041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.910033 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 21:46:06.931436 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.931413 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74nrc"] Jun 12 21:46:06.931576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.931523 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:06.934006 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.933987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pp8lc\"" Jun 12 21:46:06.934168 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.934146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 21:46:06.934237 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.934204 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 21:46:06.962675 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd41736-8960-4f22-bd5b-8767abb60376-data-volume\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.962675 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd41736-8960-4f22-bd5b-8767abb60376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd41736-8960-4f22-bd5b-8767abb60376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4871b802-03e3-4b95-a3f5-ea564a859d63-config-volume\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwzn\" (UniqueName: \"kubernetes.io/projected/4cd41736-8960-4f22-bd5b-8767abb60376-kube-api-access-8lwzn\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5qw9\" (UniqueName: \"kubernetes.io/projected/4871b802-03e3-4b95-a3f5-ea564a859d63-kube-api-access-x5qw9\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd41736-8960-4f22-bd5b-8767abb60376-crio-socket\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:06.962896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjj7\" (UniqueName: \"kubernetes.io/projected/febad53b-f672-4465-b313-71ba2278cabe-kube-api-access-5xjj7\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:06.963096 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad53b-f672-4465-b313-71ba2278cabe-cert\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:06.963096 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4871b802-03e3-4b95-a3f5-ea564a859d63-tmp-dir\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:06.963096 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:06.962959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4871b802-03e3-4b95-a3f5-ea564a859d63-metrics-tls\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.058982 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.058897 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:07.059131 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.058881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:07.059131 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.058908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:07.061659 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061630 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:46:07.061799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:46:07.061799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061716 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:46:07.061799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061726 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4b7bq\"" Jun 12 21:46:07.061799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zvgf7\"" Jun 12 21:46:07.061957 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.061671 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:46:07.063823 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjj7\" (UniqueName: \"kubernetes.io/projected/febad53b-f672-4465-b313-71ba2278cabe-kube-api-access-5xjj7\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:07.063906 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad53b-f672-4465-b313-71ba2278cabe-cert\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:07.063906 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4871b802-03e3-4b95-a3f5-ea564a859d63-tmp-dir\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.063906 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4871b802-03e3-4b95-a3f5-ea564a859d63-metrics-tls\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.064038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd41736-8960-4f22-bd5b-8767abb60376-data-volume\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd41736-8960-4f22-bd5b-8767abb60376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd41736-8960-4f22-bd5b-8767abb60376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.063996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4871b802-03e3-4b95-a3f5-ea564a859d63-config-volume\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.064038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwzn\" (UniqueName: \"kubernetes.io/projected/4cd41736-8960-4f22-bd5b-8767abb60376-kube-api-access-8lwzn\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064425 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064396 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd41736-8960-4f22-bd5b-8767abb60376-data-volume\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064517 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5qw9\" (UniqueName: \"kubernetes.io/projected/4871b802-03e3-4b95-a3f5-ea564a859d63-kube-api-access-x5qw9\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.064587 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd41736-8960-4f22-bd5b-8767abb60376-crio-socket\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064587 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd41736-8960-4f22-bd5b-8767abb60376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.064803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4871b802-03e3-4b95-a3f5-ea564a859d63-tmp-dir\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.064902 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.064811 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd41736-8960-4f22-bd5b-8767abb60376-crio-socket\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.065206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.065186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4871b802-03e3-4b95-a3f5-ea564a859d63-config-volume\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.068403 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.068382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4871b802-03e3-4b95-a3f5-ea564a859d63-metrics-tls\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.068503 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.068413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd41736-8960-4f22-bd5b-8767abb60376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.068631 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.068613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad53b-f672-4465-b313-71ba2278cabe-cert\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:07.071440 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.071412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5qw9\" (UniqueName: \"kubernetes.io/projected/4871b802-03e3-4b95-a3f5-ea564a859d63-kube-api-access-x5qw9\") pod \"dns-default-74nrc\" (UID: \"4871b802-03e3-4b95-a3f5-ea564a859d63\") " pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.071531 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.071483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwzn\" (UniqueName: \"kubernetes.io/projected/4cd41736-8960-4f22-bd5b-8767abb60376-kube-api-access-8lwzn\") pod \"insights-runtime-extractor-vbfcp\" (UID: \"4cd41736-8960-4f22-bd5b-8767abb60376\") " pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.071818 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.071797 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjj7\" (UniqueName: \"kubernetes.io/projected/febad53b-f672-4465-b313-71ba2278cabe-kube-api-access-5xjj7\") pod \"ingress-canary-tfkt4\" (UID: \"febad53b-f672-4465-b313-71ba2278cabe\") " pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:07.194914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.194872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfkt4" Jun 12 21:46:07.216081 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.216049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbfcp" Jun 12 21:46:07.239175 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.239139 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:07.442342 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.442118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfkt4"] Jun 12 21:46:07.442891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.442867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74nrc"] Jun 12 21:46:07.443901 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:07.443760 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbfcp"] Jun 12 21:46:07.450015 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:07.449989 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebad53b_f672_4465_b313_71ba2278cabe.slice/crio-a0848ca105f2d04c8d03b68661725b7d53e866abba1c7e007b8457ff78c76b1e WatchSource:0}: Error finding container a0848ca105f2d04c8d03b68661725b7d53e866abba1c7e007b8457ff78c76b1e: Status 404 returned error can't find the container with id a0848ca105f2d04c8d03b68661725b7d53e866abba1c7e007b8457ff78c76b1e Jun 12 21:46:08.307077 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:08.307035 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbfcp" event={"ID":"4cd41736-8960-4f22-bd5b-8767abb60376","Type":"ContainerStarted","Data":"d696e6d1066bf6c5d56f34ee7d26070d77dd3b50c846549ce3c08fd9c5639c09"} Jun 12 21:46:08.308994 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:08.308962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74nrc" event={"ID":"4871b802-03e3-4b95-a3f5-ea564a859d63","Type":"ContainerStarted","Data":"ddc5bded42658d4a41fc6f0d23bcd44a7d919be0e5cfb8acdc3aa457da34ed9c"} Jun 12 21:46:08.311576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:08.311513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfkt4" event={"ID":"febad53b-f672-4465-b313-71ba2278cabe","Type":"ContainerStarted","Data":"a0848ca105f2d04c8d03b68661725b7d53e866abba1c7e007b8457ff78c76b1e"} Jun 12 21:46:09.264289 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.264255 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:09.266145 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.266116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.269707 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.269657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 21:46:09.269852 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.269710 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9v7zk\"" Jun 12 21:46:09.269852 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.269715 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 21:46:09.270057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.270041 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 21:46:09.270242 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.270225 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 21:46:09.270504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.270486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 21:46:09.270588 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.270574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 21:46:09.271185 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.271030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 21:46:09.282245 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282176 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:09.282636 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.282828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.282931 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.282979 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.283028 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.282999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwrj\" (UniqueName: \"kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.283028 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.283022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.383535 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwrj\" (UniqueName: \"kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.384120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.384120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.384120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.384120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.384120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.383714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.385017 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.384984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.385163 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.385138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.385235 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.385183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.388098 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.388076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.388189 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.388078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.393424 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.393396 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwrj\" (UniqueName: \"kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj\") pod \"console-6d6b759486-wkfkc\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:09.579223 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:09.579127 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:12.042189 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.042158 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:12.323103 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.323054 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74nrc" event={"ID":"4871b802-03e3-4b95-a3f5-ea564a859d63","Type":"ContainerStarted","Data":"e9d82b3334f3b13f859096de13670035fe37beb7b32ecd0e427368476cc91df0"} Jun 12 21:46:12.323303 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.323120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74nrc" event={"ID":"4871b802-03e3-4b95-a3f5-ea564a859d63","Type":"ContainerStarted","Data":"a5e1d946815d3a9f445ae5f1a3c81c46c8f200f366b2106a08e85823504690c8"} Jun 12 21:46:12.323303 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.323200 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:12.324188 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.324169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b759486-wkfkc" event={"ID":"51ca1e0c-3e91-4b52-a65a-a5b8e4630198","Type":"ContainerStarted","Data":"f9ac29a8791ccea0d13527f48a6debf7c97116fdb529f5118a72a626327ccb1e"} Jun 12 21:46:12.325583 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.325556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfkt4" event={"ID":"febad53b-f672-4465-b313-71ba2278cabe","Type":"ContainerStarted","Data":"ae6dceb8b75776410e996eb30bd9a23bd8318c3dd92cb6f6f12cac72167ef795"} Jun 12 21:46:12.327024 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.327003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbfcp" event={"ID":"4cd41736-8960-4f22-bd5b-8767abb60376","Type":"ContainerStarted","Data":"473c4696304fa8c6ec892c5bb0445846d7a94a65643a2f2dd59aa5babd83d7f9"} Jun 12 21:46:12.341552 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:12.341499 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-74nrc" podStartSLOduration=1.9271537680000002 podStartE2EDuration="6.341484667s" totalImagesPullingTime="4.414330899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:12.340064751 +0000 UTC m=+56.782899126" watchObservedRunningTime="2026-06-12 21:46:12.341484667 +0000 UTC m=+56.784319041" Jun 12 21:46:13.024048 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.023867 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tfkt4" podStartSLOduration=2.6096806 podStartE2EDuration="7.023844144s" totalImagesPullingTime="4.414163544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:12.359245152 +0000 UTC m=+56.802079529" watchObservedRunningTime="2026-06-12 21:46:13.023844144 +0000 UTC m=+57.466678524" Jun 12 21:46:13.024842 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.024817 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:46:13.027049 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.027027 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.039632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.038881 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 21:46:13.039791 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.039637 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:46:13.111213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111654 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111654 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111654 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111654 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.111654 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.111377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgk5\" (UniqueName: \"kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212736 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212925 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212925 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212925 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212925 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgk5\" (UniqueName: \"kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.212925 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.213164 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.212939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.213529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.213499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.214299 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.214213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.214724 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.214680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.215027 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.215003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.225229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.225198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.225638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.225605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.228310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.228262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgk5\" (UniqueName: \"kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5\") pod \"console-75bfc9d7dd-b8fx6\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.333418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.333331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbfcp" event={"ID":"4cd41736-8960-4f22-bd5b-8767abb60376","Type":"ContainerStarted","Data":"753cc34796b01181549820b6e290ce138561d2769862aa51f1a8163192ecd08c"} Jun 12 21:46:13.339933 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.339908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:13.507611 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:13.507572 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:46:13.515057 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:13.515025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd25e30f_186d_427d_bf65_bf307936435a.slice/crio-5a66e3fcec02d60b1ce81ff3966ae88cb5c265fae4e7304c45eea79ebbe5bc96 WatchSource:0}: Error finding container 5a66e3fcec02d60b1ce81ff3966ae88cb5c265fae4e7304c45eea79ebbe5bc96: Status 404 returned error can't find the container with id 5a66e3fcec02d60b1ce81ff3966ae88cb5c265fae4e7304c45eea79ebbe5bc96 Jun 12 21:46:14.338407 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:14.338356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bfc9d7dd-b8fx6" event={"ID":"fd25e30f-186d-427d-bf65-bf307936435a","Type":"ContainerStarted","Data":"5a66e3fcec02d60b1ce81ff3966ae88cb5c265fae4e7304c45eea79ebbe5bc96"} Jun 12 21:46:16.350450 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.350411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbfcp" event={"ID":"4cd41736-8960-4f22-bd5b-8767abb60376","Type":"ContainerStarted","Data":"a4bc576c40148511ea9cc267b911dea12266680735f69bf7b11f6d5d1eb564a0"} Jun 12 21:46:16.351975 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.351948 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b759486-wkfkc" event={"ID":"51ca1e0c-3e91-4b52-a65a-a5b8e4630198","Type":"ContainerStarted","Data":"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f"} Jun 12 21:46:16.353337 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.353312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bfc9d7dd-b8fx6" event={"ID":"fd25e30f-186d-427d-bf65-bf307936435a","Type":"ContainerStarted","Data":"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7"} Jun 12 21:46:16.367765 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.367720 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbfcp" podStartSLOduration=2.507500918 podStartE2EDuration="10.367681764s" totalImagesPullingTime="7.860180846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:46:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:16.367503291 +0000 UTC m=+60.810337702" watchObservedRunningTime="2026-06-12 21:46:16.367681764 +0000 UTC m=+60.810516137" Jun 12 21:46:16.384660 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.384598 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6b759486-wkfkc" podStartSLOduration=3.93591697 podStartE2EDuration="7.384583561s" totalImagesPullingTime="3.448666591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:16.383519819 +0000 UTC m=+60.826354194" watchObservedRunningTime="2026-06-12 21:46:16.384583561 +0000 UTC m=+60.827417931" Jun 12 21:46:16.400474 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:16.400425 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75bfc9d7dd-b8fx6" podStartSLOduration=1.417805545 podStartE2EDuration="3.400409772s" totalImagesPullingTime="1.982604227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:16.399626211 +0000 UTC m=+60.842460588" watchObservedRunningTime="2026-06-12 21:46:16.400409772 +0000 UTC m=+60.843244146" Jun 12 21:46:17.257905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:17.257873 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmkvf" Jun 12 21:46:19.579670 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:19.579632 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:19.580089 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:19.579722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:19.581002 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:19.580981 2565 patch_prober.go:28] interesting pod/console-6d6b759486-wkfkc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jun 12 21:46:19.581044 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:19.581024 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d6b759486-wkfkc" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jun 12 21:46:21.779317 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.779283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:21.781665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.781648 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:46:21.791952 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.791932 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d78fa06-b3ee-4f88-9688-11658e599c76-original-pull-secret\") pod \"global-pull-secret-syncer-2vl6w\" (UID: \"3d78fa06-b3ee-4f88-9688-11658e599c76\") " pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:21.853177 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.853140 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl"] Jun 12 21:46:21.855570 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.855553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:21.857933 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.857907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 21:46:21.858044 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.857907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hjjt6\"" Jun 12 21:46:21.867416 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.867391 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl"] Jun 12 21:46:21.880220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.880188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pt7dl\" (UID: \"3e6cf365-2557-479b-90ac-611deebf2d84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:21.880319 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.880234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:21.882831 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.882816 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:46:21.893587 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.893568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5ad33cd-6c59-4344-ab98-0c3ef62f6afa-metrics-certs\") pod \"network-metrics-daemon-dpkvh\" (UID: \"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa\") " pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:21.981248 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.981194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:21.981248 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.981256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pt7dl\" (UID: \"3e6cf365-2557-479b-90ac-611deebf2d84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:21.981469 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:21.981344 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 12 21:46:21.981469 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:21.981401 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates podName:3e6cf365-2557-479b-90ac-611deebf2d84 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:22.481383713 +0000 UTC m=+66.924218065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-pt7dl" (UID: "3e6cf365-2557-479b-90ac-611deebf2d84") : secret "prometheus-operator-admission-webhook-tls" not found Jun 12 21:46:21.983849 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.983832 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:46:21.993574 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:21.993555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:46:22.004973 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.004950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5qv5\" (UniqueName: \"kubernetes.io/projected/8367357f-b514-4eee-ae82-89900322a1a6-kube-api-access-v5qv5\") pod \"network-check-target-r589l\" (UID: \"8367357f-b514-4eee-ae82-89900322a1a6\") " pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:22.081004 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.080931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vl6w" Jun 12 21:46:22.088987 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.088964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zvgf7\"" Jun 12 21:46:22.094103 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.094080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4b7bq\"" Jun 12 21:46:22.096898 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.096876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:22.103055 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.103035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpkvh" Jun 12 21:46:22.231478 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.231442 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2vl6w"] Jun 12 21:46:22.234994 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:22.234957 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d78fa06_b3ee_4f88_9688_11658e599c76.slice/crio-c1b4a693c50b6c661697bc1a787f25c25bbcb637abfe8ba6d95a60a932a16e3f WatchSource:0}: Error finding container c1b4a693c50b6c661697bc1a787f25c25bbcb637abfe8ba6d95a60a932a16e3f: Status 404 returned error can't find the container with id c1b4a693c50b6c661697bc1a787f25c25bbcb637abfe8ba6d95a60a932a16e3f Jun 12 21:46:22.248749 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.248725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r589l"] Jun 12 21:46:22.251609 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:22.251586 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8367357f_b514_4eee_ae82_89900322a1a6.slice/crio-b176e72cae1c57713bcc17b8eaf3cc97e03cda83285e0cbc8e702d9db12bcfa1 WatchSource:0}: Error finding container b176e72cae1c57713bcc17b8eaf3cc97e03cda83285e0cbc8e702d9db12bcfa1: Status 404 returned error can't find the container with id b176e72cae1c57713bcc17b8eaf3cc97e03cda83285e0cbc8e702d9db12bcfa1 Jun 12 21:46:22.269568 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.269542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpkvh"] Jun 12 21:46:22.271902 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:22.271884 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ad33cd_6c59_4344_ab98_0c3ef62f6afa.slice/crio-e256063e12a2169c7a1e4283d247af5d5c56e37d02f1b83dcf43a9edfcfc24bb WatchSource:0}: Error finding container e256063e12a2169c7a1e4283d247af5d5c56e37d02f1b83dcf43a9edfcfc24bb: Status 404 returned error can't find the container with id e256063e12a2169c7a1e4283d247af5d5c56e37d02f1b83dcf43a9edfcfc24bb Jun 12 21:46:22.335553 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.335488 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-74nrc" Jun 12 21:46:22.373547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.373517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpkvh" event={"ID":"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa","Type":"ContainerStarted","Data":"e256063e12a2169c7a1e4283d247af5d5c56e37d02f1b83dcf43a9edfcfc24bb"} Jun 12 21:46:22.374991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.374963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r589l" event={"ID":"8367357f-b514-4eee-ae82-89900322a1a6","Type":"ContainerStarted","Data":"b176e72cae1c57713bcc17b8eaf3cc97e03cda83285e0cbc8e702d9db12bcfa1"} Jun 12 21:46:22.376159 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.376132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2vl6w" event={"ID":"3d78fa06-b3ee-4f88-9688-11658e599c76","Type":"ContainerStarted","Data":"c1b4a693c50b6c661697bc1a787f25c25bbcb637abfe8ba6d95a60a932a16e3f"} Jun 12 21:46:22.486846 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.486813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pt7dl\" (UID: \"3e6cf365-2557-479b-90ac-611deebf2d84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:22.489392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.489361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e6cf365-2557-479b-90ac-611deebf2d84-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pt7dl\" (UID: \"3e6cf365-2557-479b-90ac-611deebf2d84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:22.765105 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.764881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:22.936844 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:22.936473 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl"] Jun 12 21:46:23.340585 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.340392 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:23.340585 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.340541 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:23.346759 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.346723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:23.382915 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.382880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" event={"ID":"3e6cf365-2557-479b-90ac-611deebf2d84","Type":"ContainerStarted","Data":"df65448e58984e71e28e462d712089f328b93116ad0d820691c97086bdeb034d"} Jun 12 21:46:23.389473 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.389434 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:46:23.461670 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:23.461507 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:24.388109 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.388055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" event={"ID":"3e6cf365-2557-479b-90ac-611deebf2d84","Type":"ContainerStarted","Data":"5136cab83530dc58133b5e34d7204f230148ef0f92e59739b890dc33b0c6534b"} Jun 12 21:46:24.389080 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.389005 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:24.393095 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.392584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpkvh" event={"ID":"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa","Type":"ContainerStarted","Data":"1180ef305b4c74530d0604a62a8e2f91fa53b4f44710f53e95e418ec7949933e"} Jun 12 21:46:24.393095 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.392631 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpkvh" event={"ID":"c5ad33cd-6c59-4344-ab98-0c3ef62f6afa","Type":"ContainerStarted","Data":"e7e3d31190246ae2152b08cdd0682faf3e053ec69b96972a71b5935b94f288fd"} Jun 12 21:46:24.395278 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.395254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" Jun 12 21:46:24.424122 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.423108 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dpkvh" podStartSLOduration=67.352575455 podStartE2EDuration="1m8.423087063s" totalImagesPullingTime="1.070511608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:24.422110349 +0000 UTC m=+68.864944724" watchObservedRunningTime="2026-06-12 21:46:24.423087063 +0000 UTC m=+68.865921438" Jun 12 21:46:24.424122 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.423398 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pt7dl" podStartSLOduration=2.161826476 podStartE2EDuration="3.423390509s" totalImagesPullingTime="1.261564033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:24.404155839 +0000 UTC m=+68.846990229" watchObservedRunningTime="2026-06-12 21:46:24.423390509 +0000 UTC m=+68.866224884" Jun 12 21:46:24.945860 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.945826 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7"] Jun 12 21:46:24.948941 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.948917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:24.952953 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.952932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 21:46:24.953519 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.953497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 21:46:24.953631 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.953613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 21:46:24.953763 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.953747 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 21:46:24.954067 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.954051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2khns\"" Jun 12 21:46:24.954731 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.954702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 21:46:24.962087 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:24.962027 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7"] Jun 12 21:46:25.008121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.008079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrclk\" (UniqueName: \"kubernetes.io/projected/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-kube-api-access-nrclk\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.008300 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.008131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.008300 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.008202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.008300 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.008234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.109549 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.109455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.109549 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.109510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.109817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.109567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrclk\" (UniqueName: \"kubernetes.io/projected/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-kube-api-access-nrclk\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.109817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.109591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.110343 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.110317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.112211 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.112187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.112339 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.112322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.118854 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.118829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrclk\" (UniqueName: \"kubernetes.io/projected/43abdfb1-14b6-4b0e-98ea-997b3f07d73a-kube-api-access-nrclk\") pod \"prometheus-operator-864fcfc6f9-qv5v7\" (UID: \"43abdfb1-14b6-4b0e-98ea-997b3f07d73a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:25.260002 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:25.259965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" Jun 12 21:46:26.962959 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:26.962924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7"] Jun 12 21:46:26.968297 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:26.968258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43abdfb1_14b6_4b0e_98ea_997b3f07d73a.slice/crio-c20dac942c20d643cbd59eecd9cab3dfdd048a7cd66b79898b948a9dd2cffb4f WatchSource:0}: Error finding container c20dac942c20d643cbd59eecd9cab3dfdd048a7cd66b79898b948a9dd2cffb4f: Status 404 returned error can't find the container with id c20dac942c20d643cbd59eecd9cab3dfdd048a7cd66b79898b948a9dd2cffb4f Jun 12 21:46:27.405637 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:27.405600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" event={"ID":"43abdfb1-14b6-4b0e-98ea-997b3f07d73a","Type":"ContainerStarted","Data":"c20dac942c20d643cbd59eecd9cab3dfdd048a7cd66b79898b948a9dd2cffb4f"} Jun 12 21:46:27.407137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:27.407110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r589l" event={"ID":"8367357f-b514-4eee-ae82-89900322a1a6","Type":"ContainerStarted","Data":"f1674102e3e5bbd2773e83d55973a857910921a93ea247bcbe78b2a1abe95bde"} Jun 12 21:46:27.407281 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:27.407214 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:46:27.408592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:27.408568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2vl6w" event={"ID":"3d78fa06-b3ee-4f88-9688-11658e599c76","Type":"ContainerStarted","Data":"c147cfce23ce83f871bc56d05368b32f144c61f9d13dfb006e056eedbb80ef3a"} Jun 12 21:46:27.432470 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:27.432421 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r589l" podStartSLOduration=66.866153411 podStartE2EDuration="1m11.432405901s" totalImagesPullingTime="4.56625249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:27.430769153 +0000 UTC m=+71.873603523" watchObservedRunningTime="2026-06-12 21:46:27.432405901 +0000 UTC m=+71.875240275" Jun 12 21:46:28.414288 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:28.414251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" event={"ID":"43abdfb1-14b6-4b0e-98ea-997b3f07d73a","Type":"ContainerStarted","Data":"6f1eb973f6aaebab17386629313c1d3187801abf2722c5ae43e151ec6a8e0049"} Jun 12 21:46:28.414638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:28.414320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" event={"ID":"43abdfb1-14b6-4b0e-98ea-997b3f07d73a","Type":"ContainerStarted","Data":"9f85a0394d04f25d7b577a7d65fcb27dc1170a580f0079098957ff0ce1a95057"} Jun 12 21:46:28.432207 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:28.432160 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qv5v7" podStartSLOduration=3.136938205 podStartE2EDuration="4.432142257s" totalImagesPullingTime="1.295204052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:28.430998013 +0000 UTC m=+72.873832450" watchObservedRunningTime="2026-06-12 21:46:28.432142257 +0000 UTC m=+72.874976669" Jun 12 21:46:28.432356 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:28.432246 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2vl6w" podStartSLOduration=67.839691989 podStartE2EDuration="1m12.432240667s" totalImagesPullingTime="4.592548678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:27.459979516 +0000 UTC m=+71.902813891" watchObservedRunningTime="2026-06-12 21:46:28.432240667 +0000 UTC m=+72.875075043" Jun 12 21:46:30.280082 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.280043 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q"] Jun 12 21:46:30.285902 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.285870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.288397 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.288361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 21:46:30.288397 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.288378 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l6fnv\"" Jun 12 21:46:30.288397 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.288381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 21:46:30.296940 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.296911 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q"] Jun 12 21:46:30.341560 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.341521 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wnv6"] Jun 12 21:46:30.345069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.345044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.347703 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.347668 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q94gv\"" Jun 12 21:46:30.348046 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.348027 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 21:46:30.348093 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.348032 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 21:46:30.348310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.348297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 21:46:30.350553 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.350530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a226982-2249-4e90-a86b-49aa65eb6e60-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.350647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.350585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.350647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.350606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.350752 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.350674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v775m\" (UniqueName: \"kubernetes.io/projected/6a226982-2249-4e90-a86b-49aa65eb6e60-kube-api-access-v775m\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.451319 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v775m\" (UniqueName: \"kubernetes.io/projected/6a226982-2249-4e90-a86b-49aa65eb6e60-kube-api-access-v775m\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.451506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a226982-2249-4e90-a86b-49aa65eb6e60-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.451506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-textfile\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhwq\" (UniqueName: \"kubernetes.io/projected/644fe6cd-548b-49ed-ac84-921de2a4e8f0-kube-api-access-zkhwq\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-root\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-wtmp\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-metrics-client-ca\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.451773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.451742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-sys\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.452161 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.452137 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a226982-2249-4e90-a86b-49aa65eb6e60-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.454118 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.454096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.454236 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.454175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a226982-2249-4e90-a86b-49aa65eb6e60-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.470392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.470358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v775m\" (UniqueName: \"kubernetes.io/projected/6a226982-2249-4e90-a86b-49aa65eb6e60-kube-api-access-v775m\") pod \"openshift-state-metrics-6b8d965dd5-nfg7q\" (UID: \"6a226982-2249-4e90-a86b-49aa65eb6e60\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.552651 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhwq\" (UniqueName: \"kubernetes.io/projected/644fe6cd-548b-49ed-ac84-921de2a4e8f0-kube-api-access-zkhwq\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552651 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-root\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552651 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-wtmp\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-root\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-metrics-client-ca\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-wtmp\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-sys\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.552914 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552893 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/644fe6cd-548b-49ed-ac84-921de2a4e8f0-sys\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.553263 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.552950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-textfile\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.553263 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:30.552991 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 21:46:30.553263 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:30.553070 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls podName:644fe6cd-548b-49ed-ac84-921de2a4e8f0 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:31.053048517 +0000 UTC m=+75.495882886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls") pod "node-exporter-2wnv6" (UID: "644fe6cd-548b-49ed-ac84-921de2a4e8f0") : secret "node-exporter-tls" not found Jun 12 21:46:30.553263 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.553254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-textfile\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.553423 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.553312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.553423 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.553334 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644fe6cd-548b-49ed-ac84-921de2a4e8f0-metrics-client-ca\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.555288 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.555266 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.561531 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.561505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhwq\" (UniqueName: \"kubernetes.io/projected/644fe6cd-548b-49ed-ac84-921de2a4e8f0-kube-api-access-zkhwq\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:30.595482 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.595446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" Jun 12 21:46:30.732339 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:30.732306 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q"] Jun 12 21:46:30.735572 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:30.735543 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a226982_2249_4e90_a86b_49aa65eb6e60.slice/crio-f44428ad2b08e551e55a26cc63ecda0ba24af1847278cc8348643c8bc6741f76 WatchSource:0}: Error finding container f44428ad2b08e551e55a26cc63ecda0ba24af1847278cc8348643c8bc6741f76: Status 404 returned error can't find the container with id f44428ad2b08e551e55a26cc63ecda0ba24af1847278cc8348643c8bc6741f76 Jun 12 21:46:31.057649 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.057552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:31.060067 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.060045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/644fe6cd-548b-49ed-ac84-921de2a4e8f0-node-exporter-tls\") pod \"node-exporter-2wnv6\" (UID: \"644fe6cd-548b-49ed-ac84-921de2a4e8f0\") " pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:31.254217 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.254179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wnv6" Jun 12 21:46:31.271700 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:31.268734 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644fe6cd_548b_49ed_ac84_921de2a4e8f0.slice/crio-64f609e1cede8e40c5b6323cfb20f3a415736a0a6e7ede99f5756ca6e6a07a5f WatchSource:0}: Error finding container 64f609e1cede8e40c5b6323cfb20f3a415736a0a6e7ede99f5756ca6e6a07a5f: Status 404 returned error can't find the container with id 64f609e1cede8e40c5b6323cfb20f3a415736a0a6e7ede99f5756ca6e6a07a5f Jun 12 21:46:31.428464 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.428363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" event={"ID":"6a226982-2249-4e90-a86b-49aa65eb6e60","Type":"ContainerStarted","Data":"d32650f8fab221c95bae42f69b61a238361055108aed284d030545aa39788851"} Jun 12 21:46:31.428464 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.428434 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" event={"ID":"6a226982-2249-4e90-a86b-49aa65eb6e60","Type":"ContainerStarted","Data":"e473d342b2029bce4972c027ad73ea24401e1ea80de7e124660cd21366f66e09"} Jun 12 21:46:31.428464 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.428459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" event={"ID":"6a226982-2249-4e90-a86b-49aa65eb6e60","Type":"ContainerStarted","Data":"f44428ad2b08e551e55a26cc63ecda0ba24af1847278cc8348643c8bc6741f76"} Jun 12 21:46:31.430284 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:31.430219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wnv6" event={"ID":"644fe6cd-548b-49ed-ac84-921de2a4e8f0","Type":"ContainerStarted","Data":"64f609e1cede8e40c5b6323cfb20f3a415736a0a6e7ede99f5756ca6e6a07a5f"} Jun 12 21:46:32.437281 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:32.437124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" event={"ID":"6a226982-2249-4e90-a86b-49aa65eb6e60","Type":"ContainerStarted","Data":"7e4230566e789702934f248adcb0fde57caed64a5dbc3b29b8f9a278104ecab8"} Jun 12 21:46:32.439108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:32.439079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wnv6" event={"ID":"644fe6cd-548b-49ed-ac84-921de2a4e8f0","Type":"ContainerStarted","Data":"8c39124f82f415da8d9c4de8cd1e846663e85ba878ad68fbe186dee0bef7042b"} Jun 12 21:46:32.457577 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:32.457521 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-nfg7q" podStartSLOduration=1.5967263649999999 podStartE2EDuration="2.457504141s" totalImagesPullingTime="860.777776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:32.455951253 +0000 UTC m=+76.898785627" watchObservedRunningTime="2026-06-12 21:46:32.457504141 +0000 UTC m=+76.900338514" Jun 12 21:46:33.444678 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:33.444642 2565 generic.go:356] "Generic (PLEG): container finished" podID="644fe6cd-548b-49ed-ac84-921de2a4e8f0" containerID="8c39124f82f415da8d9c4de8cd1e846663e85ba878ad68fbe186dee0bef7042b" exitCode=0 Jun 12 21:46:33.445213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:33.444723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wnv6" event={"ID":"644fe6cd-548b-49ed-ac84-921de2a4e8f0","Type":"ContainerDied","Data":"8c39124f82f415da8d9c4de8cd1e846663e85ba878ad68fbe186dee0bef7042b"} Jun 12 21:46:34.450343 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.450305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wnv6" event={"ID":"644fe6cd-548b-49ed-ac84-921de2a4e8f0","Type":"ContainerStarted","Data":"c434412c36a888af0e97f088087757bf7d3f35e7ecdfb4ef1971aca5fcc76d80"} Jun 12 21:46:34.450728 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.450361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wnv6" event={"ID":"644fe6cd-548b-49ed-ac84-921de2a4e8f0","Type":"ContainerStarted","Data":"eab542c4f2dd60d64ecfef452a0c4dad24f1590a46373db3e30671b234aebbf7"} Jun 12 21:46:34.478026 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.477973 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wnv6" podStartSLOduration=3.387054308 podStartE2EDuration="4.477955993s" totalImagesPullingTime="1.016497565s" totalInitContainerRuntime="74.40412ms" isStatefulPod=true podCreationTimestamp="2026-06-12 21:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:34.476994136 +0000 UTC m=+78.919828510" watchObservedRunningTime="2026-06-12 21:46:34.477955993 +0000 UTC m=+78.920790417" Jun 12 21:46:34.744602 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.744557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6ff95d8589-hnrvt"] Jun 12 21:46:34.747563 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.747548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.750276 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.750249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 21:46:34.750276 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.750262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-927ejps9uu1pe\"" Jun 12 21:46:34.750446 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.750262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 21:46:34.750446 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.750262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 21:46:34.751015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.750998 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xm5vq\"" Jun 12 21:46:34.751057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.751001 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 21:46:34.757985 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.757961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff95d8589-hnrvt"] Jun 12 21:46:34.894599 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-tls\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-audit-log\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-metrics-server-audit-profiles\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-client-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894807 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcv5\" (UniqueName: \"kubernetes.io/projected/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-kube-api-access-wrcv5\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.894972 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.894814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-client-certs\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.995973 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.995889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.995973 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.995928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-audit-log\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.995973 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.995948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-metrics-server-audit-profiles\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.995981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-client-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcv5\" (UniqueName: \"kubernetes.io/projected/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-kube-api-access-wrcv5\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-client-certs\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-tls\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996470 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-audit-log\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.996842 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.997045 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.996958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-metrics-server-audit-profiles\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.998641 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.998621 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-tls\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.998744 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.998728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-secret-metrics-server-client-certs\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:34.998881 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:34.998860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-client-ca-bundle\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:35.006994 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.006975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcv5\" (UniqueName: \"kubernetes.io/projected/b633e385-d6c1-463d-8ebd-ca37ba6eabaf-kube-api-access-wrcv5\") pod \"metrics-server-6ff95d8589-hnrvt\" (UID: \"b633e385-d6c1-463d-8ebd-ca37ba6eabaf\") " pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:35.056612 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.056567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:35.087912 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.087885 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:46:35.092081 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.092057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.101371 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.101341 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9"] Jun 12 21:46:35.104532 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.104513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.107593 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.107386 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hdz7q\"" Jun 12 21:46:35.107795 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.107771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 21:46:35.108656 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.108631 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:46:35.120512 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.120481 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9"] Jun 12 21:46:35.198657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.198657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.198909 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.198909 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.198909 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.199047 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.198952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnft\" (UniqueName: \"kubernetes.io/projected/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-kube-api-access-wqnft\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.199103 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.199052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.199103 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.199090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgrr\" (UniqueName: \"kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.199194 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.199135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.222371 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.222340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff95d8589-hnrvt"] Jun 12 21:46:35.225246 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:35.225217 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633e385_d6c1_463d_8ebd_ca37ba6eabaf.slice/crio-c0c1eef5a8f1b00e02084bb838a95f74b6c3895a0727da2a8217819b17f6d14a WatchSource:0}: Error finding container c0c1eef5a8f1b00e02084bb838a95f74b6c3895a0727da2a8217819b17f6d14a: Status 404 returned error can't find the container with id c0c1eef5a8f1b00e02084bb838a95f74b6c3895a0727da2a8217819b17f6d14a Jun 12 21:46:35.300657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnft\" (UniqueName: \"kubernetes.io/projected/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-kube-api-access-wqnft\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.300657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.300657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgrr\" (UniqueName: \"kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.300657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.301015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301015 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.300831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301247 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:35.301193 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 21:46:35.301294 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:35.301263 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert podName:641905c9-dc31-40ea-83bf-8c68a3b9e4f7 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:35.801242194 +0000 UTC m=+80.244076548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-gk2w9" (UID: "641905c9-dc31-40ea-83bf-8c68a3b9e4f7") : secret "monitoring-plugin-cert" not found Jun 12 21:46:35.301671 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.301513 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301671 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.301598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.301671 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.301598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.302093 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.302030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.303466 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.303442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.303572 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.303555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.313337 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.313309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgrr\" (UniqueName: \"kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr\") pod \"console-584886cdcc-58vhr\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.313489 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.313468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnft\" (UniqueName: \"kubernetes.io/projected/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-kube-api-access-wqnft\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.402917 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.402887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:35.456047 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.455982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" event={"ID":"b633e385-d6c1-463d-8ebd-ca37ba6eabaf","Type":"ContainerStarted","Data":"c0c1eef5a8f1b00e02084bb838a95f74b6c3895a0727da2a8217819b17f6d14a"} Jun 12 21:46:35.542225 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.542189 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:46:35.545502 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:35.545459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d41e6a2_2624_4dea_afc8_24e91a0c3f64.slice/crio-bc00ad3f9c8a0c0c059a7777f5df9929534d1c6c72c0fdc86e5e1516aa4d9ac5 WatchSource:0}: Error finding container bc00ad3f9c8a0c0c059a7777f5df9929534d1c6c72c0fdc86e5e1516aa4d9ac5: Status 404 returned error can't find the container with id bc00ad3f9c8a0c0c059a7777f5df9929534d1c6c72c0fdc86e5e1516aa4d9ac5 Jun 12 21:46:35.806418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.806319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:35.809117 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:35.809084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/641905c9-dc31-40ea-83bf-8c68a3b9e4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gk2w9\" (UID: \"641905c9-dc31-40ea-83bf-8c68a3b9e4f7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:36.018860 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:36.018829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:36.175225 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:36.174886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9"] Jun 12 21:46:36.462529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:36.462429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584886cdcc-58vhr" event={"ID":"8d41e6a2-2624-4dea-afc8-24e91a0c3f64","Type":"ContainerStarted","Data":"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc"} Jun 12 21:46:36.462529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:36.462489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584886cdcc-58vhr" event={"ID":"8d41e6a2-2624-4dea-afc8-24e91a0c3f64","Type":"ContainerStarted","Data":"bc00ad3f9c8a0c0c059a7777f5df9929534d1c6c72c0fdc86e5e1516aa4d9ac5"} Jun 12 21:46:36.480899 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:36.480825 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584886cdcc-58vhr" podStartSLOduration=1.480806 podStartE2EDuration="1.480806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:36.479567386 +0000 UTC m=+80.922401760" watchObservedRunningTime="2026-06-12 21:46:36.480806 +0000 UTC m=+80.923640375" Jun 12 21:46:36.579061 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:46:36.579013 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641905c9_dc31_40ea_83bf_8c68a3b9e4f7.slice/crio-99609404c8215b4ead696ebb5790d47807346bf77fe07e2cf2f835559f20bd72 WatchSource:0}: Error finding container 99609404c8215b4ead696ebb5790d47807346bf77fe07e2cf2f835559f20bd72: Status 404 returned error can't find the container with id 99609404c8215b4ead696ebb5790d47807346bf77fe07e2cf2f835559f20bd72 Jun 12 21:46:37.468644 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:37.468596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" event={"ID":"b633e385-d6c1-463d-8ebd-ca37ba6eabaf","Type":"ContainerStarted","Data":"0a858a2703c671425dc01e96a83115ac9216c952c03efa10164ee22b072789aa"} Jun 12 21:46:37.469922 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:37.469899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" event={"ID":"641905c9-dc31-40ea-83bf-8c68a3b9e4f7","Type":"ContainerStarted","Data":"99609404c8215b4ead696ebb5790d47807346bf77fe07e2cf2f835559f20bd72"} Jun 12 21:46:37.491241 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:37.491187 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" podStartSLOduration=2.089439734 podStartE2EDuration="3.491164984s" totalImagesPullingTime="1.40172525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:37.489366486 +0000 UTC m=+81.932200872" watchObservedRunningTime="2026-06-12 21:46:37.491164984 +0000 UTC m=+81.933999359" Jun 12 21:46:38.475237 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:38.475199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" event={"ID":"641905c9-dc31-40ea-83bf-8c68a3b9e4f7","Type":"ContainerStarted","Data":"9887ca78a8aba4f9c564b90a91db12aff86e30da228c293d5856571ae67372e6"} Jun 12 21:46:38.475602 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:38.475475 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:38.480054 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:38.480029 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" Jun 12 21:46:38.492404 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:38.492350 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gk2w9" podStartSLOduration=2.112223424 podStartE2EDuration="3.492334942s" totalImagesPullingTime="1.380111518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:38.4904653 +0000 UTC m=+82.933299675" watchObservedRunningTime="2026-06-12 21:46:38.492334942 +0000 UTC m=+82.935169316" Jun 12 21:46:45.403133 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:45.403092 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:45.403514 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:45.403157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:45.407991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:45.407964 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:45.507151 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:45.507124 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:46:45.555588 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:45.555556 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:46:48.495276 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.495212 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d6b759486-wkfkc" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerName="console" containerID="cri-o://89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f" gracePeriod=15 Jun 12 21:46:48.741307 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.741283 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:48.920672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920572 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.920672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920626 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.920938 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920677 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.920938 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zwrj\" (UniqueName: \"kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.920938 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920848 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.920938 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.920884 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config\") pod \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\" (UID: \"51ca1e0c-3e91-4b52-a65a-a5b8e4630198\") " Jun 12 21:46:48.921190 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.921162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config" (OuterVolumeSpecName: "console-config") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:48.921190 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.921179 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:48.921282 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.921173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca" (OuterVolumeSpecName: "service-ca") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:48.923269 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.923239 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:46:48.923356 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.923266 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj" (OuterVolumeSpecName: "kube-api-access-5zwrj") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "kube-api-access-5zwrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:46:48.923356 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:48.923290 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51ca1e0c-3e91-4b52-a65a-a5b8e4630198" (UID: "51ca1e0c-3e91-4b52-a65a-a5b8e4630198"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:46:49.022271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022227 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-oauth-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.022271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022263 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zwrj\" (UniqueName: \"kubernetes.io/projected/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-kube-api-access-5zwrj\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.022271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022274 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.022271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022284 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-oauth-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.022542 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022294 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-console-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.022542 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.022303 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ca1e0c-3e91-4b52-a65a-a5b8e4630198-service-ca\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:46:49.518643 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.518608 2565 generic.go:356] "Generic (PLEG): container finished" podID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerID="89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f" exitCode=0 Jun 12 21:46:49.519060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.518657 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b759486-wkfkc" Jun 12 21:46:49.519060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.518659 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b759486-wkfkc" event={"ID":"51ca1e0c-3e91-4b52-a65a-a5b8e4630198","Type":"ContainerDied","Data":"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f"} Jun 12 21:46:49.519060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.518747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b759486-wkfkc" event={"ID":"51ca1e0c-3e91-4b52-a65a-a5b8e4630198","Type":"ContainerDied","Data":"f9ac29a8791ccea0d13527f48a6debf7c97116fdb529f5118a72a626327ccb1e"} Jun 12 21:46:49.519060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.518775 2565 scope.go:117] "RemoveContainer" containerID="89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f" Jun 12 21:46:49.527777 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.527755 2565 scope.go:117] "RemoveContainer" containerID="89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f" Jun 12 21:46:49.528061 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:46:49.528040 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f\": container with ID starting with 89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f not found: ID does not exist" containerID="89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f" Jun 12 21:46:49.528113 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.528071 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f"} err="failed to get container status \"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f\": rpc error: code = NotFound desc = could not find container \"89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f\": container with ID starting with 89b61a62322096ec3d63463a0e76067ce119c89c5d134700d3694da65f0f317f not found: ID does not exist" Jun 12 21:46:49.538597 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.538576 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:49.542880 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:49.542859 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6b759486-wkfkc"] Jun 12 21:46:50.063608 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:50.063573 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" path="/var/lib/kubelet/pods/51ca1e0c-3e91-4b52-a65a-a5b8e4630198/volumes" Jun 12 21:46:55.057662 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:55.057628 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:55.058128 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:55.057716 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:46:58.416990 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:46:58.416960 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r589l" Jun 12 21:47:10.575861 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.575790 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75bfc9d7dd-b8fx6" podUID="fd25e30f-186d-427d-bf65-bf307936435a" containerName="console" containerID="cri-o://a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7" gracePeriod=15 Jun 12 21:47:10.812778 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.812751 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:47:10.882666 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882583 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882666 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882615 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882666 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882649 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882956 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882675 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lgk5\" (UniqueName: \"kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882956 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882828 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882956 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882869 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.882956 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.882917 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert\") pod \"fd25e30f-186d-427d-bf65-bf307936435a\" (UID: \"fd25e30f-186d-427d-bf65-bf307936435a\") " Jun 12 21:47:10.883137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883067 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:10.883137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883081 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config" (OuterVolumeSpecName: "console-config") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:10.883137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883086 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:10.883273 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883145 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-service-ca\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.883273 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883163 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-console-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.883273 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883177 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-oauth-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.883608 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.883581 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:10.885105 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.885082 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5" (OuterVolumeSpecName: "kube-api-access-4lgk5") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "kube-api-access-4lgk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:47:10.885179 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.885095 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:10.885179 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.885148 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd25e30f-186d-427d-bf65-bf307936435a" (UID: "fd25e30f-186d-427d-bf65-bf307936435a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:10.983891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.983850 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lgk5\" (UniqueName: \"kubernetes.io/projected/fd25e30f-186d-427d-bf65-bf307936435a-kube-api-access-4lgk5\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.983891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.983881 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-oauth-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.983891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.983890 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd25e30f-186d-427d-bf65-bf307936435a-trusted-ca-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:10.983891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:10.983899 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd25e30f-186d-427d-bf65-bf307936435a-console-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:47:11.598150 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.598110 2565 generic.go:356] "Generic (PLEG): container finished" podID="fd25e30f-186d-427d-bf65-bf307936435a" containerID="a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7" exitCode=0 Jun 12 21:47:11.598579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.598159 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bfc9d7dd-b8fx6" Jun 12 21:47:11.598579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.598161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bfc9d7dd-b8fx6" event={"ID":"fd25e30f-186d-427d-bf65-bf307936435a","Type":"ContainerDied","Data":"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7"} Jun 12 21:47:11.598579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.598214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bfc9d7dd-b8fx6" event={"ID":"fd25e30f-186d-427d-bf65-bf307936435a","Type":"ContainerDied","Data":"5a66e3fcec02d60b1ce81ff3966ae88cb5c265fae4e7304c45eea79ebbe5bc96"} Jun 12 21:47:11.598579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.598240 2565 scope.go:117] "RemoveContainer" containerID="a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7" Jun 12 21:47:11.606639 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.606619 2565 scope.go:117] "RemoveContainer" containerID="a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7" Jun 12 21:47:11.606948 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:47:11.606929 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7\": container with ID starting with a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7 not found: ID does not exist" containerID="a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7" Jun 12 21:47:11.607005 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.606958 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7"} err="failed to get container status \"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7\": rpc error: code = NotFound desc = could not find container \"a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7\": container with ID starting with a0d3792cf554903c2e2d272b87ee9364b400f881c655c597d55224bad0cd4bd7 not found: ID does not exist" Jun 12 21:47:11.617996 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.617969 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:47:11.621365 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:11.621340 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75bfc9d7dd-b8fx6"] Jun 12 21:47:12.063318 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:12.063284 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd25e30f-186d-427d-bf65-bf307936435a" path="/var/lib/kubelet/pods/fd25e30f-186d-427d-bf65-bf307936435a/volumes" Jun 12 21:47:15.062331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:15.062302 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:47:15.067264 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:15.067238 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6ff95d8589-hnrvt" Jun 12 21:47:54.646515 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646476 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59f59f7657-4szkj"] Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646744 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd25e30f-186d-427d-bf65-bf307936435a" containerName="console" Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646756 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd25e30f-186d-427d-bf65-bf307936435a" containerName="console" Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646772 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerName="console" Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646780 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerName="console" Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646817 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd25e30f-186d-427d-bf65-bf307936435a" containerName="console" Jun 12 21:47:54.647019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.646829 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ca1e0c-3e91-4b52-a65a-a5b8e4630198" containerName="console" Jun 12 21:47:54.650207 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.650180 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.652894 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.652866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 21:47:54.653035 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.652961 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 21:47:54.653035 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.652976 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 21:47:54.653035 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.652961 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fv7mj\"" Jun 12 21:47:54.653193 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.652983 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 21:47:54.653193 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.653092 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 21:47:54.659047 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.658429 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 21:47:54.663006 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.662983 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f59f7657-4szkj"] Jun 12 21:47:54.713379 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-serving-certs-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pk66\" (UniqueName: \"kubernetes.io/projected/400d6242-4112-4f38-92fc-7a5783879b21-kube-api-access-5pk66\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-metrics-client-ca\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.713773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.713598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-federate-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814535 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814736 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-metrics-client-ca\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814784 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-federate-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814920 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-serving-certs-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.814920 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.814905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pk66\" (UniqueName: \"kubernetes.io/projected/400d6242-4112-4f38-92fc-7a5783879b21-kube-api-access-5pk66\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.815282 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.815257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.815632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.815605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-serving-certs-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.815746 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.815642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-metrics-client-ca\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.815746 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.815677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.817386 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.817354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-federate-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.817527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.817509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-telemeter-client-tls\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.817796 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.817777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.817866 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.817809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400d6242-4112-4f38-92fc-7a5783879b21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.822908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.822889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pk66\" (UniqueName: \"kubernetes.io/projected/400d6242-4112-4f38-92fc-7a5783879b21-kube-api-access-5pk66\") pod \"telemeter-client-59f59f7657-4szkj\" (UID: \"400d6242-4112-4f38-92fc-7a5783879b21\") " pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:54.962232 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:54.962123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" Jun 12 21:47:55.101945 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:55.101918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f59f7657-4szkj"] Jun 12 21:47:55.104131 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:47:55.104097 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400d6242_4112_4f38_92fc_7a5783879b21.slice/crio-1eb64894ce67df4d254dfe349c5af56f6bc45bbd8be2eadb3eabb3291d0337b3 WatchSource:0}: Error finding container 1eb64894ce67df4d254dfe349c5af56f6bc45bbd8be2eadb3eabb3291d0337b3: Status 404 returned error can't find the container with id 1eb64894ce67df4d254dfe349c5af56f6bc45bbd8be2eadb3eabb3291d0337b3 Jun 12 21:47:55.764006 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:55.763969 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" event={"ID":"400d6242-4112-4f38-92fc-7a5783879b21","Type":"ContainerStarted","Data":"1eb64894ce67df4d254dfe349c5af56f6bc45bbd8be2eadb3eabb3291d0337b3"} Jun 12 21:47:57.773835 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:57.773787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" event={"ID":"400d6242-4112-4f38-92fc-7a5783879b21","Type":"ContainerStarted","Data":"a3f2cf525e05f02306352056c8dc55ec44478f5576b29396ad55d994c4de522e"} Jun 12 21:47:58.780131 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:58.780096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" event={"ID":"400d6242-4112-4f38-92fc-7a5783879b21","Type":"ContainerStarted","Data":"a5c9954acd3bfbf38ceac9a9d4a3a68af1459588e18a82be9fc39e6d6a95cd62"} Jun 12 21:47:58.780511 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:58.780156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" event={"ID":"400d6242-4112-4f38-92fc-7a5783879b21","Type":"ContainerStarted","Data":"3a8eb9a79c67ae8d3f361933e4de85a09684be17cbc8b609ddba1fa0be469b8e"} Jun 12 21:47:58.801897 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:58.801837 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59f59f7657-4szkj" podStartSLOduration=1.857315205 podStartE2EDuration="4.80182128s" totalImagesPullingTime="2.944506075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:58.800371823 +0000 UTC m=+163.243206198" watchObservedRunningTime="2026-06-12 21:47:58.80182128 +0000 UTC m=+163.244655654" Jun 12 21:47:59.547968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.547932 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:47:59.551061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.551035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.565543 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.565512 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:47:59.655701 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.655851 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.655851 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.655984 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.655984 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.655984 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.655972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.656073 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.656000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g76c\" (UniqueName: \"kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757183 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757359 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g76c\" (UniqueName: \"kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757359 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757429 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757429 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757489 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.757489 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.757477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.758070 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.758043 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.758326 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.758091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.758326 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.758131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.758487 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.758415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.759913 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.759890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.760078 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.760061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.772434 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.772413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g76c\" (UniqueName: \"kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c\") pod \"console-67dbccbd47-shkvl\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:47:59.860479 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:47:59.860399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:00.014667 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:00.014641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:48:00.017704 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:48:00.017658 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d974800_a817_48b0_9036_eb962468fb3b.slice/crio-b15242d184ec295a1fa267f4587485e63542e375e019de0d300f5be9ddcd27dd WatchSource:0}: Error finding container b15242d184ec295a1fa267f4587485e63542e375e019de0d300f5be9ddcd27dd: Status 404 returned error can't find the container with id b15242d184ec295a1fa267f4587485e63542e375e019de0d300f5be9ddcd27dd Jun 12 21:48:00.791580 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:00.791546 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbccbd47-shkvl" event={"ID":"5d974800-a817-48b0-9036-eb962468fb3b","Type":"ContainerStarted","Data":"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd"} Jun 12 21:48:00.791765 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:00.791597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbccbd47-shkvl" event={"ID":"5d974800-a817-48b0-9036-eb962468fb3b","Type":"ContainerStarted","Data":"b15242d184ec295a1fa267f4587485e63542e375e019de0d300f5be9ddcd27dd"} Jun 12 21:48:00.809660 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:00.809616 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67dbccbd47-shkvl" podStartSLOduration=1.8096031240000001 podStartE2EDuration="1.809603124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:00.808773142 +0000 UTC m=+165.251607515" watchObservedRunningTime="2026-06-12 21:48:00.809603124 +0000 UTC m=+165.252437498" Jun 12 21:48:09.860733 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:09.860617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:09.860733 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:09.860705 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:09.865492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:09.865464 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:10.830202 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:10.830173 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:10.877296 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:10.877261 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:48:10.944964 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:10.944928 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78fb4f84b4-ct46l"] Jun 12 21:48:10.949248 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:10.949227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:10.959208 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:10.959181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fb4f84b4-ct46l"] Jun 12 21:48:11.047018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.046980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-oauth-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047018 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-service-ca\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047231 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-trusted-ca-bundle\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047231 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbwm\" (UniqueName: \"kubernetes.io/projected/babb9712-f3a7-4b87-9ea2-c531daf933a5-kube-api-access-2gbwm\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047231 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-oauth-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047231 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.047231 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.047163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-oauth-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-service-ca\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-trusted-ca-bundle\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbwm\" (UniqueName: \"kubernetes.io/projected/babb9712-f3a7-4b87-9ea2-c531daf933a5-kube-api-access-2gbwm\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148744 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-oauth-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.148744 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.148376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.149262 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.149195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-service-ca\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.149262 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.149195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-oauth-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.149262 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.149206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.149586 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.149562 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/babb9712-f3a7-4b87-9ea2-c531daf933a5-trusted-ca-bundle\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.150971 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.150942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-oauth-config\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.151087 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.151071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/babb9712-f3a7-4b87-9ea2-c531daf933a5-console-serving-cert\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.156455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.156434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbwm\" (UniqueName: \"kubernetes.io/projected/babb9712-f3a7-4b87-9ea2-c531daf933a5-kube-api-access-2gbwm\") pod \"console-78fb4f84b4-ct46l\" (UID: \"babb9712-f3a7-4b87-9ea2-c531daf933a5\") " pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.258479 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.258432 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:11.394889 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.394860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fb4f84b4-ct46l"] Jun 12 21:48:11.396856 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:48:11.396826 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabb9712_f3a7_4b87_9ea2_c531daf933a5.slice/crio-fb09f1ef1dfa2eeccd9a613bdfcd2f01931b2e5ac7eabb8b868744fca58821e9 WatchSource:0}: Error finding container fb09f1ef1dfa2eeccd9a613bdfcd2f01931b2e5ac7eabb8b868744fca58821e9: Status 404 returned error can't find the container with id fb09f1ef1dfa2eeccd9a613bdfcd2f01931b2e5ac7eabb8b868744fca58821e9 Jun 12 21:48:11.831866 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.831830 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fb4f84b4-ct46l" event={"ID":"babb9712-f3a7-4b87-9ea2-c531daf933a5","Type":"ContainerStarted","Data":"aa5605fecdc4c5ecbb88e48e6baf167fab3eee378272777f02b3589c54502aec"} Jun 12 21:48:11.832043 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.831878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fb4f84b4-ct46l" event={"ID":"babb9712-f3a7-4b87-9ea2-c531daf933a5","Type":"ContainerStarted","Data":"fb09f1ef1dfa2eeccd9a613bdfcd2f01931b2e5ac7eabb8b868744fca58821e9"} Jun 12 21:48:11.850169 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:11.850115 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78fb4f84b4-ct46l" podStartSLOduration=1.850099071 podStartE2EDuration="1.850099071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:11.848834605 +0000 UTC m=+176.291668980" watchObservedRunningTime="2026-06-12 21:48:11.850099071 +0000 UTC m=+176.292933523" Jun 12 21:48:21.258631 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:21.258586 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:21.259048 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:21.258657 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:21.263213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:21.263182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:21.872394 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:21.872366 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78fb4f84b4-ct46l" Jun 12 21:48:21.920803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:21.920755 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:48:35.897558 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:35.897517 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-584886cdcc-58vhr" podUID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" containerName="console" containerID="cri-o://f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc" gracePeriod=15 Jun 12 21:48:36.140620 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.140586 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:48:36.241228 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241198 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241236 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241257 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sgrr\" (UniqueName: \"kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241294 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241314 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241333 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.241390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.241353 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config\") pod \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\" (UID: \"8d41e6a2-2624-4dea-afc8-24e91a0c3f64\") " Jun 12 21:48:36.242129 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.242055 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config" (OuterVolumeSpecName: "console-config") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:36.242129 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.242064 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:36.242392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.242153 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:36.242601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.242522 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:36.247638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.244224 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:48:36.247638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.245330 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr" (OuterVolumeSpecName: "kube-api-access-9sgrr") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "kube-api-access-9sgrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:48:36.248167 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.248144 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d41e6a2-2624-4dea-afc8-24e91a0c3f64" (UID: "8d41e6a2-2624-4dea-afc8-24e91a0c3f64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:48:36.342991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.342946 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.342991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.342981 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-trusted-ca-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.342991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.342994 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-service-ca\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.343228 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.343005 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-oauth-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.343228 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.343046 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-oauth-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.343228 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.343060 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-console-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.343228 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.343070 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sgrr\" (UniqueName: \"kubernetes.io/projected/8d41e6a2-2624-4dea-afc8-24e91a0c3f64-kube-api-access-9sgrr\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:36.920646 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.920609 2565 generic.go:356] "Generic (PLEG): container finished" podID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" containerID="f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc" exitCode=0 Jun 12 21:48:36.921108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.920676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584886cdcc-58vhr" event={"ID":"8d41e6a2-2624-4dea-afc8-24e91a0c3f64","Type":"ContainerDied","Data":"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc"} Jun 12 21:48:36.921108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.920781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584886cdcc-58vhr" event={"ID":"8d41e6a2-2624-4dea-afc8-24e91a0c3f64","Type":"ContainerDied","Data":"bc00ad3f9c8a0c0c059a7777f5df9929534d1c6c72c0fdc86e5e1516aa4d9ac5"} Jun 12 21:48:36.921108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.920702 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584886cdcc-58vhr" Jun 12 21:48:36.921108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.920803 2565 scope.go:117] "RemoveContainer" containerID="f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc" Jun 12 21:48:36.929118 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.929103 2565 scope.go:117] "RemoveContainer" containerID="f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc" Jun 12 21:48:36.929401 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:48:36.929382 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc\": container with ID starting with f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc not found: ID does not exist" containerID="f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc" Jun 12 21:48:36.929440 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.929411 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc"} err="failed to get container status \"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc\": rpc error: code = NotFound desc = could not find container \"f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc\": container with ID starting with f0f823e498005ea140997631cb35d52d51867778aee3b79ba710d70ba9b8f4fc not found: ID does not exist" Jun 12 21:48:36.941053 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.941026 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:48:36.946637 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:36.946616 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584886cdcc-58vhr"] Jun 12 21:48:38.062835 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:38.062806 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" path="/var/lib/kubelet/pods/8d41e6a2-2624-4dea-afc8-24e91a0c3f64/volumes" Jun 12 21:48:46.943659 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:46.943611 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67dbccbd47-shkvl" podUID="5d974800-a817-48b0-9036-eb962468fb3b" containerName="console" containerID="cri-o://669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd" gracePeriod=15 Jun 12 21:48:47.180796 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.180770 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:47.229505 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229410 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g76c\" (UniqueName: \"kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229505 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229463 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229505 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229491 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229533 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229557 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229605 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.229829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.229628 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config\") pod \"5d974800-a817-48b0-9036-eb962468fb3b\" (UID: \"5d974800-a817-48b0-9036-eb962468fb3b\") " Jun 12 21:48:47.230320 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.230003 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:47.230320 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.230117 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:47.230320 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.230186 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config" (OuterVolumeSpecName: "console-config") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:47.230320 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.230259 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:48:47.232007 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.231983 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:48:47.232220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.232198 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:48:47.232311 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.232222 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c" (OuterVolumeSpecName: "kube-api-access-5g76c") pod "5d974800-a817-48b0-9036-eb962468fb3b" (UID: "5d974800-a817-48b0-9036-eb962468fb3b"). InnerVolumeSpecName "kube-api-access-5g76c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:48:47.330632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330591 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g76c\" (UniqueName: \"kubernetes.io/projected/5d974800-a817-48b0-9036-eb962468fb3b-kube-api-access-5g76c\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330622 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-console-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330631 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-trusted-ca-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330640 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-oauth-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330936 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330648 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-serving-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330936 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330656 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d974800-a817-48b0-9036-eb962468fb3b-service-ca\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.330936 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.330665 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d974800-a817-48b0-9036-eb962468fb3b-console-oauth-config\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:48:47.961301 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.961250 2565 generic.go:356] "Generic (PLEG): container finished" podID="5d974800-a817-48b0-9036-eb962468fb3b" containerID="669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd" exitCode=0 Jun 12 21:48:47.961679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.961319 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbccbd47-shkvl" Jun 12 21:48:47.961679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.961331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbccbd47-shkvl" event={"ID":"5d974800-a817-48b0-9036-eb962468fb3b","Type":"ContainerDied","Data":"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd"} Jun 12 21:48:47.961679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.961406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbccbd47-shkvl" event={"ID":"5d974800-a817-48b0-9036-eb962468fb3b","Type":"ContainerDied","Data":"b15242d184ec295a1fa267f4587485e63542e375e019de0d300f5be9ddcd27dd"} Jun 12 21:48:47.961679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.961427 2565 scope.go:117] "RemoveContainer" containerID="669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd" Jun 12 21:48:47.969924 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.969908 2565 scope.go:117] "RemoveContainer" containerID="669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd" Jun 12 21:48:47.970192 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:48:47.970172 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd\": container with ID starting with 669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd not found: ID does not exist" containerID="669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd" Jun 12 21:48:47.970240 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.970201 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd"} err="failed to get container status \"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd\": rpc error: code = NotFound desc = could not find container \"669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd\": container with ID starting with 669499afc6bb3c117a0f139c7dadfcf8d2d1b3ee26181fc48617531b7403e7cd not found: ID does not exist" Jun 12 21:48:47.982057 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.982027 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:48:47.986505 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:47.986483 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67dbccbd47-shkvl"] Jun 12 21:48:48.063256 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:48.063225 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d974800-a817-48b0-9036-eb962468fb3b" path="/var/lib/kubelet/pods/5d974800-a817-48b0-9036-eb962468fb3b/volumes" Jun 12 21:48:57.624349 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624308 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x"] Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624674 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" containerName="console" Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624711 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" containerName="console" Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624742 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d974800-a817-48b0-9036-eb962468fb3b" containerName="console" Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624752 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d974800-a817-48b0-9036-eb962468fb3b" containerName="console" Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624814 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d974800-a817-48b0-9036-eb962468fb3b" containerName="console" Jun 12 21:48:57.624862 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.624825 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d41e6a2-2624-4dea-afc8-24e91a0c3f64" containerName="console" Jun 12 21:48:57.629496 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.629472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.631989 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.631968 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:48:57.632739 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.632723 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:48:57.632834 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.632750 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:48:57.636404 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.636365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x"] Jun 12 21:48:57.710344 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.710302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.710530 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.710401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.710530 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.710436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnchv\" (UniqueName: \"kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.811558 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.811508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.811732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.811587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.811732 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.811616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnchv\" (UniqueName: \"kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.811998 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.811975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.812035 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.811994 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.820083 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.820059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnchv\" (UniqueName: \"kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:57.939501 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:57.939405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:48:58.076188 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:58.076157 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x"] Jun 12 21:48:58.079511 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:48:58.079484 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301ce001_7c3b_4e60_ba50_113c5f74dcaa.slice/crio-2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f WatchSource:0}: Error finding container 2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f: Status 404 returned error can't find the container with id 2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f Jun 12 21:48:59.004492 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:48:59.004451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" event={"ID":"301ce001-7c3b-4e60-ba50-113c5f74dcaa","Type":"ContainerStarted","Data":"2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f"} Jun 12 21:49:06.031824 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:06.031782 2565 generic.go:356] "Generic (PLEG): container finished" podID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerID="01c107ca3bc5e4816e4350ae70c00210c47e35441e6d929b5b4b76a9f8e96d2a" exitCode=0 Jun 12 21:49:06.032258 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:06.031878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" event={"ID":"301ce001-7c3b-4e60-ba50-113c5f74dcaa","Type":"ContainerDied","Data":"01c107ca3bc5e4816e4350ae70c00210c47e35441e6d929b5b4b76a9f8e96d2a"} Jun 12 21:49:09.044951 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:09.044916 2565 generic.go:356] "Generic (PLEG): container finished" podID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerID="6833995eb71b9f40548e76f6bcefa3e2c0291f48a3a567c37b507e7de5eb7211" exitCode=0 Jun 12 21:49:09.045391 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:09.044989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" event={"ID":"301ce001-7c3b-4e60-ba50-113c5f74dcaa","Type":"ContainerDied","Data":"6833995eb71b9f40548e76f6bcefa3e2c0291f48a3a567c37b507e7de5eb7211"} Jun 12 21:49:17.077253 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:17.077219 2565 generic.go:356] "Generic (PLEG): container finished" podID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerID="45c4083e166f099ba3683fc484a9c1e9e0f09c3d892dcbf6950e031973fa2038" exitCode=0 Jun 12 21:49:17.077617 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:17.077275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" event={"ID":"301ce001-7c3b-4e60-ba50-113c5f74dcaa","Type":"ContainerDied","Data":"45c4083e166f099ba3683fc484a9c1e9e0f09c3d892dcbf6950e031973fa2038"} Jun 12 21:49:18.205019 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.204991 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:49:18.286812 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.286784 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle\") pod \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " Jun 12 21:49:18.286812 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.286813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util\") pod \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " Jun 12 21:49:18.287024 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.286844 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnchv\" (UniqueName: \"kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv\") pod \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\" (UID: \"301ce001-7c3b-4e60-ba50-113c5f74dcaa\") " Jun 12 21:49:18.287381 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.287358 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle" (OuterVolumeSpecName: "bundle") pod "301ce001-7c3b-4e60-ba50-113c5f74dcaa" (UID: "301ce001-7c3b-4e60-ba50-113c5f74dcaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:18.289217 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.289189 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv" (OuterVolumeSpecName: "kube-api-access-tnchv") pod "301ce001-7c3b-4e60-ba50-113c5f74dcaa" (UID: "301ce001-7c3b-4e60-ba50-113c5f74dcaa"). InnerVolumeSpecName "kube-api-access-tnchv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:18.291257 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.291237 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util" (OuterVolumeSpecName: "util") pod "301ce001-7c3b-4e60-ba50-113c5f74dcaa" (UID: "301ce001-7c3b-4e60-ba50-113c5f74dcaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:18.387672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.387582 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnchv\" (UniqueName: \"kubernetes.io/projected/301ce001-7c3b-4e60-ba50-113c5f74dcaa-kube-api-access-tnchv\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.387672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.387614 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.387672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:18.387628 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/301ce001-7c3b-4e60-ba50-113c5f74dcaa-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:19.086817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:19.086788 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" Jun 12 21:49:19.086986 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:19.086783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzw9x" event={"ID":"301ce001-7c3b-4e60-ba50-113c5f74dcaa","Type":"ContainerDied","Data":"2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f"} Jun 12 21:49:19.086986 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:19.086910 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2971bbc704cdcc6724631ee389b3c1d5a2d62d584b30ed04cdf30c5237fa736f" Jun 12 21:49:25.614918 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.614885 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp"] Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615130 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="extract" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615141 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="extract" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615156 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="pull" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615162 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="pull" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615170 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="util" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615175 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="util" Jun 12 21:49:25.615348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.615215 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="301ce001-7c3b-4e60-ba50-113c5f74dcaa" containerName="extract" Jun 12 21:49:25.618151 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.618135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.620579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.620555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:49:25.620717 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.620558 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 12 21:49:25.621137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.621120 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7vgsr\"" Jun 12 21:49:25.631312 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.631293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp"] Jun 12 21:49:25.637361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.632156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hvm\" (UniqueName: \"kubernetes.io/projected/f980609e-4f3f-47d4-b727-e69ef614d967-kube-api-access-g4hvm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.637361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.632599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980609e-4f3f-47d4-b727-e69ef614d967-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.733529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.733494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hvm\" (UniqueName: \"kubernetes.io/projected/f980609e-4f3f-47d4-b727-e69ef614d967-kube-api-access-g4hvm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.733529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.733537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980609e-4f3f-47d4-b727-e69ef614d967-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.733959 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.733940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980609e-4f3f-47d4-b727-e69ef614d967-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.755758 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.755727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hvm\" (UniqueName: \"kubernetes.io/projected/f980609e-4f3f-47d4-b727-e69ef614d967-kube-api-access-g4hvm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k67lp\" (UID: \"f980609e-4f3f-47d4-b727-e69ef614d967\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:25.927138 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:25.927039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" Jun 12 21:49:26.067098 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:26.067074 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp"] Jun 12 21:49:26.069111 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:26.069086 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf980609e_4f3f_47d4_b727_e69ef614d967.slice/crio-ebd1b188d29d6e70bbff48614c1cb43277f790983d11360f4794be1a68fb4658 WatchSource:0}: Error finding container ebd1b188d29d6e70bbff48614c1cb43277f790983d11360f4794be1a68fb4658: Status 404 returned error can't find the container with id ebd1b188d29d6e70bbff48614c1cb43277f790983d11360f4794be1a68fb4658 Jun 12 21:49:26.111662 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:26.111628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" event={"ID":"f980609e-4f3f-47d4-b727-e69ef614d967","Type":"ContainerStarted","Data":"ebd1b188d29d6e70bbff48614c1cb43277f790983d11360f4794be1a68fb4658"} Jun 12 21:49:28.122427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:28.122394 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" event={"ID":"f980609e-4f3f-47d4-b727-e69ef614d967","Type":"ContainerStarted","Data":"67d3eb922b0813b8ed22b9af908100dec02a12c17f075f39e28ed50d3e184181"} Jun 12 21:49:28.149132 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:28.149081 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k67lp" podStartSLOduration=1.188441152 podStartE2EDuration="3.14906301s" totalImagesPullingTime="1.960621858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:28.146631548 +0000 UTC m=+252.589465948" watchObservedRunningTime="2026-06-12 21:49:28.14906301 +0000 UTC m=+252.591897384" Jun 12 21:49:29.479427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.479392 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f"] Jun 12 21:49:29.482610 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.482595 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.485296 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.485273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:49:29.485402 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.485306 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:49:29.486027 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.486010 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:49:29.491972 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.491949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f"] Jun 12 21:49:29.559061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.559028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.559061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.559066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.559286 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.559090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m4bx\" (UniqueName: \"kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.659450 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.659416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.659450 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.659460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.659737 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.659483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m4bx\" (UniqueName: \"kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.659842 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.659820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.659945 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.659925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.667564 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.667545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m4bx\" (UniqueName: \"kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.795301 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.795271 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:29.925390 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:29.925353 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f"] Jun 12 21:49:29.928071 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:29.928046 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905208f5_67c8_4962_a322_cdbbe35c353f.slice/crio-500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba WatchSource:0}: Error finding container 500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba: Status 404 returned error can't find the container with id 500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba Jun 12 21:49:30.131672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.131578 2565 generic.go:356] "Generic (PLEG): container finished" podID="905208f5-67c8-4962-a322-cdbbe35c353f" containerID="9f5d03dd05adff3d6fb47c7a78d3ebac83953b3e10c3962db5d63c99c0e1badb" exitCode=0 Jun 12 21:49:30.131672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.131652 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" event={"ID":"905208f5-67c8-4962-a322-cdbbe35c353f","Type":"ContainerDied","Data":"9f5d03dd05adff3d6fb47c7a78d3ebac83953b3e10c3962db5d63c99c0e1badb"} Jun 12 21:49:30.131880 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.131762 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" event={"ID":"905208f5-67c8-4962-a322-cdbbe35c353f","Type":"ContainerStarted","Data":"500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba"} Jun 12 21:49:30.501996 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.501959 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mxm84"] Jun 12 21:49:30.505046 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.505023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.507586 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.507559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jzwbv\"" Jun 12 21:49:30.507725 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.507559 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 21:49:30.507725 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.507570 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 21:49:30.515050 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.515027 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mxm84"] Jun 12 21:49:30.565611 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.565570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z564l\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-kube-api-access-z564l\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.565611 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.565614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.666203 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.666148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z564l\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-kube-api-access-z564l\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.666374 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.666213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.675380 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.675352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.675672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.675651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z564l\" (UniqueName: \"kubernetes.io/projected/ffdb983f-90f1-4418-9dff-635add6990ce-kube-api-access-z564l\") pod \"cert-manager-webhook-7dc76cbb94-mxm84\" (UID: \"ffdb983f-90f1-4418-9dff-635add6990ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.824174 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.824079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:30.974799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:30.974761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mxm84"] Jun 12 21:49:30.977519 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:30.977476 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffdb983f_90f1_4418_9dff_635add6990ce.slice/crio-53914054609be85ea1ea53d0340dea8f939bb6691308d7705b3ddf461dbc7b30 WatchSource:0}: Error finding container 53914054609be85ea1ea53d0340dea8f939bb6691308d7705b3ddf461dbc7b30: Status 404 returned error can't find the container with id 53914054609be85ea1ea53d0340dea8f939bb6691308d7705b3ddf461dbc7b30 Jun 12 21:49:31.137810 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:31.137714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" event={"ID":"ffdb983f-90f1-4418-9dff-635add6990ce","Type":"ContainerStarted","Data":"53914054609be85ea1ea53d0340dea8f939bb6691308d7705b3ddf461dbc7b30"} Jun 12 21:49:32.146380 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:32.146344 2565 generic.go:356] "Generic (PLEG): container finished" podID="905208f5-67c8-4962-a322-cdbbe35c353f" containerID="d335e3c004bb126ab7647b22278b3ab204467dc468d36f7398fe285c7f9b5f6a" exitCode=0 Jun 12 21:49:32.146774 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:32.146427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" event={"ID":"905208f5-67c8-4962-a322-cdbbe35c353f","Type":"ContainerDied","Data":"d335e3c004bb126ab7647b22278b3ab204467dc468d36f7398fe285c7f9b5f6a"} Jun 12 21:49:33.153565 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:33.153527 2565 generic.go:356] "Generic (PLEG): container finished" podID="905208f5-67c8-4962-a322-cdbbe35c353f" containerID="941a55dbbd309be82ce0dec3abee0a372313ea3465f7f6220841d2579c162144" exitCode=0 Jun 12 21:49:33.153990 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:33.153606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" event={"ID":"905208f5-67c8-4962-a322-cdbbe35c353f","Type":"ContainerDied","Data":"941a55dbbd309be82ce0dec3abee0a372313ea3465f7f6220841d2579c162144"} Jun 12 21:49:34.107772 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.107681 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8"] Jun 12 21:49:34.110814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.110798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.114117 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.114091 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-462kp\"" Jun 12 21:49:34.119814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.119791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8"] Jun 12 21:49:34.159311 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.159273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" event={"ID":"ffdb983f-90f1-4418-9dff-635add6990ce","Type":"ContainerStarted","Data":"949b5ec204067577ba4ca132c6e60e8d533ca1182228384225de17efaa2a1f68"} Jun 12 21:49:34.159720 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.159535 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:34.175336 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.175288 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" podStartSLOduration=1.308557054 podStartE2EDuration="4.175272272s" totalImagesPullingTime="2.866715218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:34.174089569 +0000 UTC m=+258.616923945" watchObservedRunningTime="2026-06-12 21:49:34.175272272 +0000 UTC m=+258.618106667" Jun 12 21:49:34.190527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.190496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.190765 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.190744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6tv\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-kube-api-access-vk6tv\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.283108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.283084 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:34.291921 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.291892 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m4bx\" (UniqueName: \"kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx\") pod \"905208f5-67c8-4962-a322-cdbbe35c353f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " Jun 12 21:49:34.292092 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.292073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.292209 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.292192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6tv\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-kube-api-access-vk6tv\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.294020 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.293989 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx" (OuterVolumeSpecName: "kube-api-access-7m4bx") pod "905208f5-67c8-4962-a322-cdbbe35c353f" (UID: "905208f5-67c8-4962-a322-cdbbe35c353f"). InnerVolumeSpecName "kube-api-access-7m4bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:34.300212 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.300187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.300333 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.300204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6tv\" (UniqueName: \"kubernetes.io/projected/55e21ab4-6694-41e0-98e0-cdd62c89486b-kube-api-access-vk6tv\") pod \"cert-manager-cainjector-5d99449ffd-qvwz8\" (UID: \"55e21ab4-6694-41e0-98e0-cdd62c89486b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.393084 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.392986 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle\") pod \"905208f5-67c8-4962-a322-cdbbe35c353f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " Jun 12 21:49:34.393084 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.393027 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util\") pod \"905208f5-67c8-4962-a322-cdbbe35c353f\" (UID: \"905208f5-67c8-4962-a322-cdbbe35c353f\") " Jun 12 21:49:34.393287 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.393234 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m4bx\" (UniqueName: \"kubernetes.io/projected/905208f5-67c8-4962-a322-cdbbe35c353f-kube-api-access-7m4bx\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:34.393369 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.393348 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle" (OuterVolumeSpecName: "bundle") pod "905208f5-67c8-4962-a322-cdbbe35c353f" (UID: "905208f5-67c8-4962-a322-cdbbe35c353f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:34.397832 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.397811 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util" (OuterVolumeSpecName: "util") pod "905208f5-67c8-4962-a322-cdbbe35c353f" (UID: "905208f5-67c8-4962-a322-cdbbe35c353f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:34.419433 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.419408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" Jun 12 21:49:34.494376 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.494348 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:34.494376 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.494373 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905208f5-67c8-4962-a322-cdbbe35c353f-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:34.543765 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:34.543735 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8"] Jun 12 21:49:34.546612 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:34.546584 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e21ab4_6694_41e0_98e0_cdd62c89486b.slice/crio-e300d399ffd3b650a76aab10e48e641f9c4793bf7a4783d9daac088c29c80463 WatchSource:0}: Error finding container e300d399ffd3b650a76aab10e48e641f9c4793bf7a4783d9daac088c29c80463: Status 404 returned error can't find the container with id e300d399ffd3b650a76aab10e48e641f9c4793bf7a4783d9daac088c29c80463 Jun 12 21:49:35.165801 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.165761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" event={"ID":"55e21ab4-6694-41e0-98e0-cdd62c89486b","Type":"ContainerStarted","Data":"75a5af20b1a287e329f3ad761cb36e3ff929054089983f64ffff1dc3ce89af05"} Jun 12 21:49:35.166255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.165809 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" event={"ID":"55e21ab4-6694-41e0-98e0-cdd62c89486b","Type":"ContainerStarted","Data":"e300d399ffd3b650a76aab10e48e641f9c4793bf7a4783d9daac088c29c80463"} Jun 12 21:49:35.167644 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.167620 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" Jun 12 21:49:35.167644 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.167615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4cg5f" event={"ID":"905208f5-67c8-4962-a322-cdbbe35c353f","Type":"ContainerDied","Data":"500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba"} Jun 12 21:49:35.167783 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.167672 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="500ce10382ef5153e1759ed0a1d84b81600386b1bd405dcc073d02ca079ec4ba" Jun 12 21:49:35.183087 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:35.183044 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qvwz8" podStartSLOduration=1.183028934 podStartE2EDuration="1.183028934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:35.181936163 +0000 UTC m=+259.624770539" watchObservedRunningTime="2026-06-12 21:49:35.183028934 +0000 UTC m=+259.625863307" Jun 12 21:49:40.170863 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:40.170833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mxm84" Jun 12 21:49:41.112648 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.112610 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-nr6nd"] Jun 12 21:49:41.112966 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.112949 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="extract" Jun 12 21:49:41.113061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.112970 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="extract" Jun 12 21:49:41.113061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.112982 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="util" Jun 12 21:49:41.113061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.112991 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="util" Jun 12 21:49:41.113061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.113001 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="pull" Jun 12 21:49:41.113061 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.113008 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="pull" Jun 12 21:49:41.113295 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.113152 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="905208f5-67c8-4962-a322-cdbbe35c353f" containerName="extract" Jun 12 21:49:41.114989 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.114969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.117500 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.117479 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8p9zc\"" Jun 12 21:49:41.126511 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.126487 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-nr6nd"] Jun 12 21:49:41.141129 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.141102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-bound-sa-token\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.141246 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.141190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-729zn\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-kube-api-access-729zn\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.242200 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.242167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-bound-sa-token\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.242536 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.242222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-729zn\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-kube-api-access-729zn\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.253395 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.253364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-bound-sa-token\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.253769 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.253752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-729zn\" (UniqueName: \"kubernetes.io/projected/4f58f0d1-e29b-45f8-889c-7c4e0d599507-kube-api-access-729zn\") pod \"cert-manager-59c77684cc-nr6nd\" (UID: \"4f58f0d1-e29b-45f8-889c-7c4e0d599507\") " pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.429138 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.429034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-nr6nd" Jun 12 21:49:41.495756 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.493245 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2"] Jun 12 21:49:41.496455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.496428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.499547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.498786 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:49:41.499547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.499023 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9wp5c\"" Jun 12 21:49:41.499547 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.499291 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 21:49:41.511932 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.511895 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2"] Jun 12 21:49:41.544740 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.544704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.544895 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.544808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gvl\" (UniqueName: \"kubernetes.io/projected/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-kube-api-access-29gvl\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.596005 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.595975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-nr6nd"] Jun 12 21:49:41.599219 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:41.599189 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f58f0d1_e29b_45f8_889c_7c4e0d599507.slice/crio-f76571919f3806b054907ca61957e4e3d8b39ea8bd417d857259211c0d46d59f WatchSource:0}: Error finding container f76571919f3806b054907ca61957e4e3d8b39ea8bd417d857259211c0d46d59f: Status 404 returned error can't find the container with id f76571919f3806b054907ca61957e4e3d8b39ea8bd417d857259211c0d46d59f Jun 12 21:49:41.645755 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.645734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gvl\" (UniqueName: \"kubernetes.io/projected/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-kube-api-access-29gvl\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.645874 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.645787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.646085 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.646070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.654867 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.654848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gvl\" (UniqueName: \"kubernetes.io/projected/bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d-kube-api-access-29gvl\") pod \"openshift-lws-operator-fd8ccff4c-pvpg2\" (UID: \"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.821708 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.821665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" Jun 12 21:49:41.951326 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:41.951301 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2"] Jun 12 21:49:41.953257 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:41.953232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd4f2cd1_00fb_47ae_9cf9_7029a8d9f22d.slice/crio-0bed66a787f832467863fee453154c598c68ff0a49170d0cbcad8ebc68a16d19 WatchSource:0}: Error finding container 0bed66a787f832467863fee453154c598c68ff0a49170d0cbcad8ebc68a16d19: Status 404 returned error can't find the container with id 0bed66a787f832467863fee453154c598c68ff0a49170d0cbcad8ebc68a16d19 Jun 12 21:49:42.198315 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:42.198238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" event={"ID":"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d","Type":"ContainerStarted","Data":"0bed66a787f832467863fee453154c598c68ff0a49170d0cbcad8ebc68a16d19"} Jun 12 21:49:42.199894 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:42.199865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-nr6nd" event={"ID":"4f58f0d1-e29b-45f8-889c-7c4e0d599507","Type":"ContainerStarted","Data":"bce6fe0f7d39dd64d8e0d59a2bbd6476a12f3a25b0a2499a7193dbfcf575a078"} Jun 12 21:49:42.200033 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:42.199903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-nr6nd" event={"ID":"4f58f0d1-e29b-45f8-889c-7c4e0d599507","Type":"ContainerStarted","Data":"f76571919f3806b054907ca61957e4e3d8b39ea8bd417d857259211c0d46d59f"} Jun 12 21:49:42.216896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:42.216850 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-nr6nd" podStartSLOduration=1.216835267 podStartE2EDuration="1.216835267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:42.215283699 +0000 UTC m=+266.658118075" watchObservedRunningTime="2026-06-12 21:49:42.216835267 +0000 UTC m=+266.659669641" Jun 12 21:49:44.213567 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:44.213534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" event={"ID":"bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d","Type":"ContainerStarted","Data":"5b0387d86d4b82d44cbd8e3d436a16fb6d8bcd8de810429a328cb1721bc292c0"} Jun 12 21:49:44.230504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:44.230454 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pvpg2" podStartSLOduration=1.5120242130000001 podStartE2EDuration="3.230438031s" totalImagesPullingTime="1.718413818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:44.228936756 +0000 UTC m=+268.671771128" watchObservedRunningTime="2026-06-12 21:49:44.230438031 +0000 UTC m=+268.673272407" Jun 12 21:49:47.197053 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.197009 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8"] Jun 12 21:49:47.200605 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.200576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.203453 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.203432 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:49:47.203619 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.203605 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:49:47.204306 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.204286 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:49:47.213299 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.213273 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8"] Jun 12 21:49:47.293203 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.293173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.293203 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.293207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.293407 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.293247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzb8r\" (UniqueName: \"kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.394284 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.394243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.394284 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.394291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.394522 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.394332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzb8r\" (UniqueName: \"kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.394858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.394738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.395115 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.394768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.414494 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.414465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzb8r\" (UniqueName: \"kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.509517 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.509480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:47.639405 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:47.639378 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8"] Jun 12 21:49:47.641863 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:49:47.641828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3d6fe3_21fa_48f8_9089_23a0e67c5d09.slice/crio-63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7 WatchSource:0}: Error finding container 63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7: Status 404 returned error can't find the container with id 63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7 Jun 12 21:49:48.232552 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:48.232517 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerID="69eb7a1d9224f634c2f006ad6db70a43c0d3a046194d241e6c3368888051c498" exitCode=0 Jun 12 21:49:48.232964 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:48.232589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerDied","Data":"69eb7a1d9224f634c2f006ad6db70a43c0d3a046194d241e6c3368888051c498"} Jun 12 21:49:48.232964 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:48.232630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerStarted","Data":"63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7"} Jun 12 21:49:49.238111 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:49.238076 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerStarted","Data":"371515190f09ea467f6c01680ef1cb5265a8a08f276fb2cf4973deb829b4dd9c"} Jun 12 21:49:50.244251 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:50.244218 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerID="371515190f09ea467f6c01680ef1cb5265a8a08f276fb2cf4973deb829b4dd9c" exitCode=0 Jun 12 21:49:50.244666 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:50.244277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerDied","Data":"371515190f09ea467f6c01680ef1cb5265a8a08f276fb2cf4973deb829b4dd9c"} Jun 12 21:49:51.250967 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:51.250935 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerID="2ffd6117272089026ab6dfb03a783497f398b2120433aaeddd20af66b3ae3043" exitCode=0 Jun 12 21:49:51.250967 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:51.250973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerDied","Data":"2ffd6117272089026ab6dfb03a783497f398b2120433aaeddd20af66b3ae3043"} Jun 12 21:49:52.376117 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.376091 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:49:52.442125 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.442087 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util\") pod \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " Jun 12 21:49:52.442281 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.442175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzb8r\" (UniqueName: \"kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r\") pod \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " Jun 12 21:49:52.442281 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.442211 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle\") pod \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\" (UID: \"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09\") " Jun 12 21:49:52.442961 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.442927 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle" (OuterVolumeSpecName: "bundle") pod "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" (UID: "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:52.444388 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.444365 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r" (OuterVolumeSpecName: "kube-api-access-dzb8r") pod "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" (UID: "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09"). InnerVolumeSpecName "kube-api-access-dzb8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:52.447527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.447506 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util" (OuterVolumeSpecName: "util") pod "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" (UID: "3a3d6fe3-21fa-48f8-9089-23a0e67c5d09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:52.542992 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.542909 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:52.542992 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.542936 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:52.542992 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:52.542945 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzb8r\" (UniqueName: \"kubernetes.io/projected/3a3d6fe3-21fa-48f8-9089-23a0e67c5d09-kube-api-access-dzb8r\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:49:53.261182 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:53.261144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" event={"ID":"3a3d6fe3-21fa-48f8-9089-23a0e67c5d09","Type":"ContainerDied","Data":"63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7"} Jun 12 21:49:53.261339 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:53.261191 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63dc01ff99d9cb99ea9784b51c7961dde8f853f84dbe3db829647d61610d55c7" Jun 12 21:49:53.261339 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:49:53.261160 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr76v8" Jun 12 21:50:00.505757 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.505723 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9"] Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.505984 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="extract" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.505995 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="extract" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.506005 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="pull" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.506009 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="pull" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.506025 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="util" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.506030 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="util" Jun 12 21:50:00.506158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.506085 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3d6fe3-21fa-48f8-9089-23a0e67c5d09" containerName="extract" Jun 12 21:50:00.508665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.508637 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.516680 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.516658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 21:50:00.516828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.516705 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 21:50:00.516828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.516762 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 21:50:00.517066 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.517037 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2654x\"" Jun 12 21:50:00.524491 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.524477 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 21:50:00.532911 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.532886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9"] Jun 12 21:50:00.609599 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.609569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-tmp\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.609790 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.609605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.609790 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.609634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-manifests\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.609790 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.609737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.609790 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.609776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slsg5\" (UniqueName: \"kubernetes.io/projected/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-kube-api-access-slsg5\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.710909 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.710875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.711076 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.710919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slsg5\" (UniqueName: \"kubernetes.io/projected/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-kube-api-access-slsg5\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.711076 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.711039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-tmp\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.711143 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.711085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.711143 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.711115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-manifests\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.711502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.711473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-manifests\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.713425 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.713397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-tmp\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.713533 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.713489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.713616 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.713599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.723585 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.723557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slsg5\" (UniqueName: \"kubernetes.io/projected/eefea6d2-c49d-4c85-87b7-9135cc8a7f30-kube-api-access-slsg5\") pod \"opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9\" (UID: \"eefea6d2-c49d-4c85-87b7-9135cc8a7f30\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.818801 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.818718 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:00.958613 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:00.958585 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9"] Jun 12 21:50:00.960832 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:00.960806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefea6d2_c49d_4c85_87b7_9135cc8a7f30.slice/crio-84fbae45d079be1c4bd6958bbd08746282b985572716ae0fd17d75af30ebe164 WatchSource:0}: Error finding container 84fbae45d079be1c4bd6958bbd08746282b985572716ae0fd17d75af30ebe164: Status 404 returned error can't find the container with id 84fbae45d079be1c4bd6958bbd08746282b985572716ae0fd17d75af30ebe164 Jun 12 21:50:01.296585 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:01.296550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" event={"ID":"eefea6d2-c49d-4c85-87b7-9135cc8a7f30","Type":"ContainerStarted","Data":"84fbae45d079be1c4bd6958bbd08746282b985572716ae0fd17d75af30ebe164"} Jun 12 21:50:04.313543 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:04.313496 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" event={"ID":"eefea6d2-c49d-4c85-87b7-9135cc8a7f30","Type":"ContainerStarted","Data":"39fefc8cdad4bf4c78fbf582a3e008452dfb254151b2581819653ef88437d7e5"} Jun 12 21:50:05.319773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:05.319737 2565 generic.go:356] "Generic (PLEG): container finished" podID="eefea6d2-c49d-4c85-87b7-9135cc8a7f30" containerID="39fefc8cdad4bf4c78fbf582a3e008452dfb254151b2581819653ef88437d7e5" exitCode=0 Jun 12 21:50:05.320158 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:05.319825 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" event={"ID":"eefea6d2-c49d-4c85-87b7-9135cc8a7f30","Type":"ContainerDied","Data":"39fefc8cdad4bf4c78fbf582a3e008452dfb254151b2581819653ef88437d7e5"} Jun 12 21:50:06.326243 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:06.326207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" event={"ID":"eefea6d2-c49d-4c85-87b7-9135cc8a7f30","Type":"ContainerStarted","Data":"5157c4a1796f98d62e4cd340e1d920da2801bc855d8114bcfc2398fb944e8694"} Jun 12 21:50:06.326636 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:06.326349 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:06.368375 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:06.368314 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" podStartSLOduration=2.279485478 podStartE2EDuration="6.368296572s" totalImagesPullingTime="3.105619697s" totalInitContainerRuntime="983.191397ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:06.365618648 +0000 UTC m=+290.808453022" watchObservedRunningTime="2026-06-12 21:50:06.368296572 +0000 UTC m=+290.811130946" Jun 12 21:50:15.998616 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:15.998585 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:50:15.999146 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:15.998596 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:50:16.004330 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:16.004305 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 21:50:17.332856 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:17.332825 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9" Jun 12 21:50:20.533392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.533349 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b"] Jun 12 21:50:20.539350 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.539319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.549459 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.549432 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 21:50:20.549583 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.549443 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 21:50:20.550392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.550364 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 21:50:20.550520 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.550406 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 21:50:20.550520 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.550414 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tzffw\"" Jun 12 21:50:20.569929 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.569893 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b"] Jun 12 21:50:20.688069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.688024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsdfp\" (UniqueName: \"kubernetes.io/projected/07b93271-e0b5-454e-b42f-d401e7220870-kube-api-access-lsdfp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.688069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.688073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b93271-e0b5-454e-b42f-d401e7220870-tmp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.688336 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.688185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b93271-e0b5-454e-b42f-d401e7220870-tls-certs\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.788715 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.788603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b93271-e0b5-454e-b42f-d401e7220870-tls-certs\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.788896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.788744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsdfp\" (UniqueName: \"kubernetes.io/projected/07b93271-e0b5-454e-b42f-d401e7220870-kube-api-access-lsdfp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.788896 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.788791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b93271-e0b5-454e-b42f-d401e7220870-tmp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.791526 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.791498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b93271-e0b5-454e-b42f-d401e7220870-tmp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.791762 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.791738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b93271-e0b5-454e-b42f-d401e7220870-tls-certs\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.835537 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.835506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsdfp\" (UniqueName: \"kubernetes.io/projected/07b93271-e0b5-454e-b42f-d401e7220870-kube-api-access-lsdfp\") pod \"kube-auth-proxy-56b869f4f6-w7f6b\" (UID: \"07b93271-e0b5-454e-b42f-d401e7220870\") " pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:20.849358 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:20.849318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" Jun 12 21:50:21.022290 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:21.022262 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b"] Jun 12 21:50:21.024427 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:21.024399 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b93271_e0b5_454e_b42f_d401e7220870.slice/crio-65faf8d6b0498ba434fef4c524335efe03987d6fdc3ce3a71af34ac60f9ea070 WatchSource:0}: Error finding container 65faf8d6b0498ba434fef4c524335efe03987d6fdc3ce3a71af34ac60f9ea070: Status 404 returned error can't find the container with id 65faf8d6b0498ba434fef4c524335efe03987d6fdc3ce3a71af34ac60f9ea070 Jun 12 21:50:21.026336 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:21.026317 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:50:21.395142 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:21.395110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" event={"ID":"07b93271-e0b5-454e-b42f-d401e7220870","Type":"ContainerStarted","Data":"65faf8d6b0498ba434fef4c524335efe03987d6fdc3ce3a71af34ac60f9ea070"} Jun 12 21:50:22.330529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.330493 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jbwmh"] Jun 12 21:50:22.338770 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.337787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.351962 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.351937 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8hk2p\"" Jun 12 21:50:22.353640 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.353514 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 21:50:22.355672 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.355605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jbwmh"] Jun 12 21:50:22.500918 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.500884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bnnf\" (UniqueName: \"kubernetes.io/projected/cad94fc8-ea03-49f6-8282-62d7ebdd6526-kube-api-access-7bnnf\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.501115 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.500966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad94fc8-ea03-49f6-8282-62d7ebdd6526-tls-certs\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.601996 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.601907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad94fc8-ea03-49f6-8282-62d7ebdd6526-tls-certs\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.602170 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.602025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bnnf\" (UniqueName: \"kubernetes.io/projected/cad94fc8-ea03-49f6-8282-62d7ebdd6526-kube-api-access-7bnnf\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.604835 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.604810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad94fc8-ea03-49f6-8282-62d7ebdd6526-tls-certs\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.630753 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.630720 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6"] Jun 12 21:50:22.635730 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.635683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.641201 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.640962 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:50:22.641201 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.640983 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:50:22.641395 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.641259 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:50:22.666145 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.666113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bnnf\" (UniqueName: \"kubernetes.io/projected/cad94fc8-ea03-49f6-8282-62d7ebdd6526-kube-api-access-7bnnf\") pod \"model-serving-api-5dd488fc48-jbwmh\" (UID: \"cad94fc8-ea03-49f6-8282-62d7ebdd6526\") " pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:22.675805 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.675769 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6"] Jun 12 21:50:22.804173 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.804128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmwr\" (UniqueName: \"kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.804372 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.804205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.804372 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.804244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.905593 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.905511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmwr\" (UniqueName: \"kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.905593 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.905564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.905809 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.905611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.906043 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.906027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.906081 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.906063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.917202 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.917163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmwr\" (UniqueName: \"kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.947548 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.947512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:22.951760 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:22.951708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:23.770718 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:23.770658 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6"] Jun 12 21:50:23.774384 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:23.774339 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2b843d_65dd_4d75_83cf_e92aead1eaae.slice/crio-1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3 WatchSource:0}: Error finding container 1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3: Status 404 returned error can't find the container with id 1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3 Jun 12 21:50:23.792002 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:23.791975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jbwmh"] Jun 12 21:50:23.795289 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:23.795254 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad94fc8_ea03_49f6_8282_62d7ebdd6526.slice/crio-12fcff4e1c4c2b54841cca255dd05458fb84d1591eee71c3c66c7817754b2737 WatchSource:0}: Error finding container 12fcff4e1c4c2b54841cca255dd05458fb84d1591eee71c3c66c7817754b2737: Status 404 returned error can't find the container with id 12fcff4e1c4c2b54841cca255dd05458fb84d1591eee71c3c66c7817754b2737 Jun 12 21:50:24.412392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.412363 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerID="ab4f79d42f95aabdb520905612a57b7a1cbbc76d29b9e884aa77d6d8556fe40f" exitCode=0 Jun 12 21:50:24.412573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.412455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerDied","Data":"ab4f79d42f95aabdb520905612a57b7a1cbbc76d29b9e884aa77d6d8556fe40f"} Jun 12 21:50:24.412573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.412510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerStarted","Data":"1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3"} Jun 12 21:50:24.413799 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.413733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" event={"ID":"cad94fc8-ea03-49f6-8282-62d7ebdd6526","Type":"ContainerStarted","Data":"12fcff4e1c4c2b54841cca255dd05458fb84d1591eee71c3c66c7817754b2737"} Jun 12 21:50:24.415566 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.415541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" event={"ID":"07b93271-e0b5-454e-b42f-d401e7220870","Type":"ContainerStarted","Data":"27acefa4d41bb6ac8917b966af05036180846431c8bf4a8a91b1b8b7b328c7c6"} Jun 12 21:50:24.475356 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:24.475272 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56b869f4f6-w7f6b" podStartSLOduration=1.859632864 podStartE2EDuration="4.475249411s" totalImagesPullingTime="2.615616547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:24.475223465 +0000 UTC m=+308.918057842" watchObservedRunningTime="2026-06-12 21:50:24.475249411 +0000 UTC m=+308.918083810" Jun 12 21:50:25.423469 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:25.423430 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerStarted","Data":"dbf5f5195f48d571e3ac4a9bf6d55008ce3f6a6ddded6b31fc851e39ac2eb61c"} Jun 12 21:50:25.425380 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:25.425335 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" event={"ID":"cad94fc8-ea03-49f6-8282-62d7ebdd6526","Type":"ContainerStarted","Data":"1d835093b785bd5185cd47c86075a163c5019b61b735a0e0545d78ce288af3b6"} Jun 12 21:50:25.425568 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:25.425547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:25.509204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:25.509147 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" podStartSLOduration=2.124830893 podStartE2EDuration="3.509131076s" totalImagesPullingTime="1.384300183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:25.507367788 +0000 UTC m=+309.950202165" watchObservedRunningTime="2026-06-12 21:50:25.509131076 +0000 UTC m=+309.951965476" Jun 12 21:50:26.431342 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:26.431300 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerID="dbf5f5195f48d571e3ac4a9bf6d55008ce3f6a6ddded6b31fc851e39ac2eb61c" exitCode=0 Jun 12 21:50:26.431772 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:26.431391 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerDied","Data":"dbf5f5195f48d571e3ac4a9bf6d55008ce3f6a6ddded6b31fc851e39ac2eb61c"} Jun 12 21:50:27.442942 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:27.442907 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerID="c33b6b96d8d28af820f5759c6ce25bc8d717d28addc1e2c8dc04f34ddc67c682" exitCode=0 Jun 12 21:50:27.443314 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:27.442989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerDied","Data":"c33b6b96d8d28af820f5759c6ce25bc8d717d28addc1e2c8dc04f34ddc67c682"} Jun 12 21:50:28.572260 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.572238 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:28.651965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.651929 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util\") pod \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " Jun 12 21:50:28.652160 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.651985 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kmwr\" (UniqueName: \"kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr\") pod \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " Jun 12 21:50:28.652160 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.652023 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle\") pod \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\" (UID: \"fa2b843d-65dd-4d75-83cf-e92aead1eaae\") " Jun 12 21:50:28.652856 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.652827 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle" (OuterVolumeSpecName: "bundle") pod "fa2b843d-65dd-4d75-83cf-e92aead1eaae" (UID: "fa2b843d-65dd-4d75-83cf-e92aead1eaae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:50:28.654183 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.654160 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr" (OuterVolumeSpecName: "kube-api-access-8kmwr") pod "fa2b843d-65dd-4d75-83cf-e92aead1eaae" (UID: "fa2b843d-65dd-4d75-83cf-e92aead1eaae"). InnerVolumeSpecName "kube-api-access-8kmwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:50:28.657586 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.657565 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util" (OuterVolumeSpecName: "util") pod "fa2b843d-65dd-4d75-83cf-e92aead1eaae" (UID: "fa2b843d-65dd-4d75-83cf-e92aead1eaae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:50:28.753220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.753184 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:28.753220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.753214 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kmwr\" (UniqueName: \"kubernetes.io/projected/fa2b843d-65dd-4d75-83cf-e92aead1eaae-kube-api-access-8kmwr\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:28.753220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:28.753225 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa2b843d-65dd-4d75-83cf-e92aead1eaae-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:29.453621 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:29.453587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" event={"ID":"fa2b843d-65dd-4d75-83cf-e92aead1eaae","Type":"ContainerDied","Data":"1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3"} Jun 12 21:50:29.453814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:29.453637 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ad8273474ff9656bc8c4ca8ed143429adc617c2b6d386fd94237a09598164f3" Jun 12 21:50:29.453814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:29.453602 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06cqwr6" Jun 12 21:50:33.086661 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.086611 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5rfzh"] Jun 12 21:50:33.087134 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087108 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="pull" Jun 12 21:50:33.087134 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087126 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="pull" Jun 12 21:50:33.087261 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087141 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="util" Jun 12 21:50:33.087261 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087149 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="util" Jun 12 21:50:33.087261 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087173 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="extract" Jun 12 21:50:33.087261 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087182 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="extract" Jun 12 21:50:33.087437 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.087272 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2b843d-65dd-4d75-83cf-e92aead1eaae" containerName="extract" Jun 12 21:50:33.089941 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.089917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.092679 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.092659 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 21:50:33.092821 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.092726 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kcvfx\"" Jun 12 21:50:33.127880 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.127846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5rfzh"] Jun 12 21:50:33.129460 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.129439 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp"] Jun 12 21:50:33.132408 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.132385 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.136913 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.136887 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tjdsp\"" Jun 12 21:50:33.137036 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.136891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 21:50:33.150274 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.150237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp"] Jun 12 21:50:33.190762 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.190734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.190762 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.190768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.190965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.190806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm8bq\" (UniqueName: \"kubernetes.io/projected/277feba3-708a-4928-bf48-7fe67304ca25-kube-api-access-nm8bq\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.190965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.190860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g8r6\" (UniqueName: \"kubernetes.io/projected/5f07c388-a955-4505-813f-962925b575fa-kube-api-access-6g8r6\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.291531 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.291498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.291531 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.291534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.291791 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.291567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm8bq\" (UniqueName: \"kubernetes.io/projected/277feba3-708a-4928-bf48-7fe67304ca25-kube-api-access-nm8bq\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.291791 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.291591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g8r6\" (UniqueName: \"kubernetes.io/projected/5f07c388-a955-4505-813f-962925b575fa-kube-api-access-6g8r6\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.291791 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:50:33.291666 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 12 21:50:33.291791 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:50:33.291782 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert podName:5f07c388-a955-4505-813f-962925b575fa nodeName:}" failed. No retries permitted until 2026-06-12 21:50:33.791765256 +0000 UTC m=+318.234599612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert") pod "llmisvc-controller-manager-864bfd7bc9-7bpbp" (UID: "5f07c388-a955-4505-813f-962925b575fa") : secret "llmisvc-webhook-server-cert" not found Jun 12 21:50:33.291990 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:50:33.291667 2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 12 21:50:33.291990 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:50:33.291870 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert podName:277feba3-708a-4928-bf48-7fe67304ca25 nodeName:}" failed. No retries permitted until 2026-06-12 21:50:33.791849452 +0000 UTC m=+318.234683823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert") pod "kserve-controller-manager-69fc866d76-5rfzh" (UID: "277feba3-708a-4928-bf48-7fe67304ca25") : secret "kserve-webhook-server-cert" not found Jun 12 21:50:33.322056 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.322017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g8r6\" (UniqueName: \"kubernetes.io/projected/5f07c388-a955-4505-813f-962925b575fa-kube-api-access-6g8r6\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.322245 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.322222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm8bq\" (UniqueName: \"kubernetes.io/projected/277feba3-708a-4928-bf48-7fe67304ca25-kube-api-access-nm8bq\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.795934 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.795891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:33.796121 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.796037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.798647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.798622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277feba3-708a-4928-bf48-7fe67304ca25-cert\") pod \"kserve-controller-manager-69fc866d76-5rfzh\" (UID: \"277feba3-708a-4928-bf48-7fe67304ca25\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:33.798647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:33.798640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f07c388-a955-4505-813f-962925b575fa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7bpbp\" (UID: \"5f07c388-a955-4505-813f-962925b575fa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:34.000956 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.000920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:34.042282 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.042241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:34.158666 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.158644 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5rfzh"] Jun 12 21:50:34.208471 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.208444 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp"] Jun 12 21:50:34.209895 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:34.209860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f07c388_a955_4505_813f_962925b575fa.slice/crio-68e832c2b6d76e1fece05f6fcb87568035e2507c9e548acdfc74289ae83ebcec WatchSource:0}: Error finding container 68e832c2b6d76e1fece05f6fcb87568035e2507c9e548acdfc74289ae83ebcec: Status 404 returned error can't find the container with id 68e832c2b6d76e1fece05f6fcb87568035e2507c9e548acdfc74289ae83ebcec Jun 12 21:50:34.479110 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.479020 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" event={"ID":"277feba3-708a-4928-bf48-7fe67304ca25","Type":"ContainerStarted","Data":"4a7fc642b8f1b001b460cae57a2f144a9bb6ae72ef03eb891487f311fc36fe8e"} Jun 12 21:50:34.480096 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:34.480068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" event={"ID":"5f07c388-a955-4505-813f-962925b575fa","Type":"ContainerStarted","Data":"68e832c2b6d76e1fece05f6fcb87568035e2507c9e548acdfc74289ae83ebcec"} Jun 12 21:50:36.436136 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:36.436103 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-jbwmh" Jun 12 21:50:37.737991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.737952 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf"] Jun 12 21:50:37.741364 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.741338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.744873 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.744840 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:50:37.745612 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.745588 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:50:37.746287 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.746268 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:50:37.775237 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.775200 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf"] Jun 12 21:50:37.830210 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.830174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpfx\" (UniqueName: \"kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.830386 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.830217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.830386 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.830251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.931166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.931078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czpfx\" (UniqueName: \"kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.931166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.931118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.931166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.931157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.931552 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.931532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.931552 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.931546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:37.944753 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:37.944680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpfx\" (UniqueName: \"kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:38.052770 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.052732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:38.216657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.216632 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf"] Jun 12 21:50:38.218705 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:38.218660 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf09138_d8c4_4702_991d_c83b5af897a7.slice/crio-a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527 WatchSource:0}: Error finding container a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527: Status 404 returned error can't find the container with id a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527 Jun 12 21:50:38.507871 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.507831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" event={"ID":"5f07c388-a955-4505-813f-962925b575fa","Type":"ContainerStarted","Data":"848cf684173deab709a875826f8c20476729a7c5cbac5de9e3653e4de9375962"} Jun 12 21:50:38.508058 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.507896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:50:38.509355 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.509324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" event={"ID":"277feba3-708a-4928-bf48-7fe67304ca25","Type":"ContainerStarted","Data":"4cf10b9c6082baa1c4ad1bc21496b057f3761a479baa5679ee00d87708acf2cd"} Jun 12 21:50:38.509819 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.509377 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:50:38.510805 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.510784 2565 generic.go:356] "Generic (PLEG): container finished" podID="baf09138-d8c4-4702-991d-c83b5af897a7" containerID="bdc6a0becfc70261886bccc68a6ad67f9e6406d4204249df22518545990a8453" exitCode=0 Jun 12 21:50:38.510913 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.510831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" event={"ID":"baf09138-d8c4-4702-991d-c83b5af897a7","Type":"ContainerDied","Data":"bdc6a0becfc70261886bccc68a6ad67f9e6406d4204249df22518545990a8453"} Jun 12 21:50:38.510913 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.510860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" event={"ID":"baf09138-d8c4-4702-991d-c83b5af897a7","Type":"ContainerStarted","Data":"a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527"} Jun 12 21:50:38.628544 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.628492 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" podStartSLOduration=2.246735462 podStartE2EDuration="5.628474944s" totalImagesPullingTime="3.381739482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:38.625213388 +0000 UTC m=+323.068047761" watchObservedRunningTime="2026-06-12 21:50:38.628474944 +0000 UTC m=+323.071309330" Jun 12 21:50:38.671461 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:38.671399 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" podStartSLOduration=2.245949378 podStartE2EDuration="5.671382242s" totalImagesPullingTime="3.425432864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:38.668939747 +0000 UTC m=+323.111774120" watchObservedRunningTime="2026-06-12 21:50:38.671382242 +0000 UTC m=+323.114216615" Jun 12 21:50:39.517540 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:39.517506 2565 generic.go:356] "Generic (PLEG): container finished" podID="baf09138-d8c4-4702-991d-c83b5af897a7" containerID="2d8786edff2c211332c2ad58d2dcb30ca78ee89f14b6f62f16a6fa786d5677fd" exitCode=0 Jun 12 21:50:39.517958 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:39.517596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" event={"ID":"baf09138-d8c4-4702-991d-c83b5af897a7","Type":"ContainerDied","Data":"2d8786edff2c211332c2ad58d2dcb30ca78ee89f14b6f62f16a6fa786d5677fd"} Jun 12 21:50:40.525204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.525172 2565 generic.go:356] "Generic (PLEG): container finished" podID="baf09138-d8c4-4702-991d-c83b5af897a7" containerID="e062c63ba3725ccf4fd69461f00781bfd96fb217c20e1e9e0266ecfe964c3d4e" exitCode=0 Jun 12 21:50:40.525604 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.525230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" event={"ID":"baf09138-d8c4-4702-991d-c83b5af897a7","Type":"ContainerDied","Data":"e062c63ba3725ccf4fd69461f00781bfd96fb217c20e1e9e0266ecfe964c3d4e"} Jun 12 21:50:40.611204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.611168 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm"] Jun 12 21:50:40.614579 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.614552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.621889 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.621864 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 21:50:40.622016 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.621997 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 21:50:40.622088 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.622025 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4n9tj\"" Jun 12 21:50:40.650339 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.650312 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm"] Jun 12 21:50:40.655408 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.655386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2e4b96d8-e089-4807-a83d-90b6ce79c960-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.655527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.655418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsjdf\" (UniqueName: \"kubernetes.io/projected/2e4b96d8-e089-4807-a83d-90b6ce79c960-kube-api-access-rsjdf\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.756701 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.756664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2e4b96d8-e089-4807-a83d-90b6ce79c960-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.756894 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.756725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsjdf\" (UniqueName: \"kubernetes.io/projected/2e4b96d8-e089-4807-a83d-90b6ce79c960-kube-api-access-rsjdf\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.759549 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.759518 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2e4b96d8-e089-4807-a83d-90b6ce79c960-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.769715 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.769659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsjdf\" (UniqueName: \"kubernetes.io/projected/2e4b96d8-e089-4807-a83d-90b6ce79c960-kube-api-access-rsjdf\") pod \"servicemesh-operator3-57f65f65fb-lc2cm\" (UID: \"2e4b96d8-e089-4807-a83d-90b6ce79c960\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:40.924166 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:40.924078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:41.114555 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:41.114524 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4b96d8_e089_4807_a83d_90b6ce79c960.slice/crio-70cb1899fb94f0705eba33dc576d040afc17113dc3144676e359ab3d6092b078 WatchSource:0}: Error finding container 70cb1899fb94f0705eba33dc576d040afc17113dc3144676e359ab3d6092b078: Status 404 returned error can't find the container with id 70cb1899fb94f0705eba33dc576d040afc17113dc3144676e359ab3d6092b078 Jun 12 21:50:41.117872 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.117841 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm"] Jun 12 21:50:41.535041 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.534879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" event={"ID":"2e4b96d8-e089-4807-a83d-90b6ce79c960","Type":"ContainerStarted","Data":"70cb1899fb94f0705eba33dc576d040afc17113dc3144676e359ab3d6092b078"} Jun 12 21:50:41.705976 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.705940 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:41.766160 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.766022 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle\") pod \"baf09138-d8c4-4702-991d-c83b5af897a7\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " Jun 12 21:50:41.766160 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.766066 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czpfx\" (UniqueName: \"kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx\") pod \"baf09138-d8c4-4702-991d-c83b5af897a7\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " Jun 12 21:50:41.766160 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.766133 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util\") pod \"baf09138-d8c4-4702-991d-c83b5af897a7\" (UID: \"baf09138-d8c4-4702-991d-c83b5af897a7\") " Jun 12 21:50:41.767400 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.767368 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle" (OuterVolumeSpecName: "bundle") pod "baf09138-d8c4-4702-991d-c83b5af897a7" (UID: "baf09138-d8c4-4702-991d-c83b5af897a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:50:41.770029 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.769990 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx" (OuterVolumeSpecName: "kube-api-access-czpfx") pod "baf09138-d8c4-4702-991d-c83b5af897a7" (UID: "baf09138-d8c4-4702-991d-c83b5af897a7"). InnerVolumeSpecName "kube-api-access-czpfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:50:41.773226 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.773193 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util" (OuterVolumeSpecName: "util") pod "baf09138-d8c4-4702-991d-c83b5af897a7" (UID: "baf09138-d8c4-4702-991d-c83b5af897a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:50:41.867881 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.867794 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:41.867881 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.867829 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czpfx\" (UniqueName: \"kubernetes.io/projected/baf09138-d8c4-4702-991d-c83b5af897a7-kube-api-access-czpfx\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:41.867881 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:41.867842 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf09138-d8c4-4702-991d-c83b5af897a7-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:50:42.546924 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:42.546896 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" Jun 12 21:50:42.547374 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:42.546889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajpbdf" event={"ID":"baf09138-d8c4-4702-991d-c83b5af897a7","Type":"ContainerDied","Data":"a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527"} Jun 12 21:50:42.547374 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:42.547027 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a915fb8bc03fa3c67d08c4e725bcff44a1f600e2d0181f319cf7fb5118b10527" Jun 12 21:50:43.555917 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:43.555807 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" event={"ID":"2e4b96d8-e089-4807-a83d-90b6ce79c960","Type":"ContainerStarted","Data":"04b540e2ef719c283a09c1633054b5e07680bed7a09dfdb11a2ed60ee2bd9606"} Jun 12 21:50:43.555917 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:43.555870 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:45.204775 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.204710 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" podStartSLOduration=3.037045455 podStartE2EDuration="5.204668743s" totalImagesPullingTime="2.167623288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:43.65199112 +0000 UTC m=+328.094825495" watchObservedRunningTime="2026-06-12 21:50:45.204668743 +0000 UTC m=+329.647503117" Jun 12 21:50:45.206408 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206382 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7"] Jun 12 21:50:45.206762 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206746 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="pull" Jun 12 21:50:45.206858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206764 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="pull" Jun 12 21:50:45.206858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206783 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="util" Jun 12 21:50:45.206858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206793 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="util" Jun 12 21:50:45.206858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206818 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="extract" Jun 12 21:50:45.206858 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206827 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="extract" Jun 12 21:50:45.207088 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.206926 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf09138-d8c4-4702-991d-c83b5af897a7" containerName="extract" Jun 12 21:50:45.210073 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.210053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.213217 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.213195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 21:50:45.213385 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.213364 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 21:50:45.213481 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.213426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z752b\"" Jun 12 21:50:45.213609 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.213593 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 21:50:45.214253 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.214236 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 21:50:45.220681 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.220657 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7"] Jun 12 21:50:45.300017 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.299976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4640035f-08c6-4215-96d7-c5634db8473d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.300426 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.300294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225mg\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-kube-api-access-225mg\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401624 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225mg\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-kube-api-access-225mg\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401624 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401893 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4640035f-08c6-4215-96d7-c5634db8473d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401893 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401893 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.401893 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.402069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.401919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.402596 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.402571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.404345 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.404316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.404430 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.404352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.404615 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.404597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4640035f-08c6-4215-96d7-c5634db8473d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.404678 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.404645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4640035f-08c6-4215-96d7-c5634db8473d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.410210 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.410185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.410446 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.410428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-225mg\" (UniqueName: \"kubernetes.io/projected/4640035f-08c6-4215-96d7-c5634db8473d-kube-api-access-225mg\") pod \"istiod-openshift-gateway-75c67f8887-v8tp7\" (UID: \"4640035f-08c6-4215-96d7-c5634db8473d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.522298 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.522259 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:45.686526 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:45.686482 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7"] Jun 12 21:50:45.691044 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:45.691010 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640035f_08c6_4215_96d7_c5634db8473d.slice/crio-936fee5dc875e7f0be732505d75d268ea91a8280f002251af5faf55419e39e2c WatchSource:0}: Error finding container 936fee5dc875e7f0be732505d75d268ea91a8280f002251af5faf55419e39e2c: Status 404 returned error can't find the container with id 936fee5dc875e7f0be732505d75d268ea91a8280f002251af5faf55419e39e2c Jun 12 21:50:46.574876 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:46.574837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" event={"ID":"4640035f-08c6-4215-96d7-c5634db8473d","Type":"ContainerStarted","Data":"936fee5dc875e7f0be732505d75d268ea91a8280f002251af5faf55419e39e2c"} Jun 12 21:50:48.140069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:48.140031 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 21:50:48.140392 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:48.140102 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 21:50:48.589611 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:48.589568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" event={"ID":"4640035f-08c6-4215-96d7-c5634db8473d","Type":"ContainerStarted","Data":"b4ccb531e84affc0f0f2067e50c603052bb07094612843575daa96ef6b960ce9"} Jun 12 21:50:48.589829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:48.589737 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:48.613698 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:48.613630 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" podStartSLOduration=1.167069103 podStartE2EDuration="3.613614419s" totalImagesPullingTime="2.446545316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:48.611082853 +0000 UTC m=+333.053917227" watchObservedRunningTime="2026-06-12 21:50:48.613614419 +0000 UTC m=+333.056448794" Jun 12 21:50:49.598076 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:49.598040 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-v8tp7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 12 21:50:49.598453 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:49.598112 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" podUID="4640035f-08c6-4215-96d7-c5634db8473d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 21:50:52.597204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:52.597170 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-v8tp7" Jun 12 21:50:53.110108 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.110072 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-699967dd46-jsmdr"] Jun 12 21:50:53.113397 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.113381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.116559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.116540 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s5tqn\"" Jun 12 21:50:53.116851 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.116830 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 21:50:53.123607 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.123580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-699967dd46-jsmdr"] Jun 12 21:50:53.275143 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.274951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c51b279a-2772-4e4b-bebf-81cdca64c04d-redirect-config\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.275143 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.275006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmwf9\" (UniqueName: \"kubernetes.io/projected/c51b279a-2772-4e4b-bebf-81cdca64c04d-kube-api-access-vmwf9\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.375806 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.375717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c51b279a-2772-4e4b-bebf-81cdca64c04d-redirect-config\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.375806 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.375756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmwf9\" (UniqueName: \"kubernetes.io/projected/c51b279a-2772-4e4b-bebf-81cdca64c04d-kube-api-access-vmwf9\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.376368 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.376349 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c51b279a-2772-4e4b-bebf-81cdca64c04d-redirect-config\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.384357 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.384329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmwf9\" (UniqueName: \"kubernetes.io/projected/c51b279a-2772-4e4b-bebf-81cdca64c04d-kube-api-access-vmwf9\") pod \"dashboard-redirect-699967dd46-jsmdr\" (UID: \"c51b279a-2772-4e4b-bebf-81cdca64c04d\") " pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.426414 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.426379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" Jun 12 21:50:53.572372 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.572349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-699967dd46-jsmdr"] Jun 12 21:50:53.574540 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:50:53.574510 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51b279a_2772_4e4b_bebf_81cdca64c04d.slice/crio-497e10ea01297cf04e9547b3a386e7c0d5db7a2e2e802e2c7f9887c2713be70f WatchSource:0}: Error finding container 497e10ea01297cf04e9547b3a386e7c0d5db7a2e2e802e2c7f9887c2713be70f: Status 404 returned error can't find the container with id 497e10ea01297cf04e9547b3a386e7c0d5db7a2e2e802e2c7f9887c2713be70f Jun 12 21:50:53.616774 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:53.616741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" event={"ID":"c51b279a-2772-4e4b-bebf-81cdca64c04d","Type":"ContainerStarted","Data":"497e10ea01297cf04e9547b3a386e7c0d5db7a2e2e802e2c7f9887c2713be70f"} Jun 12 21:50:54.563707 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:54.563669 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lc2cm" Jun 12 21:50:56.635639 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:56.635605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" event={"ID":"c51b279a-2772-4e4b-bebf-81cdca64c04d","Type":"ContainerStarted","Data":"d5094f785fdf0e88427e7cc9f0dfb292d29b54ec00d80eb06887c4e56d8ce692"} Jun 12 21:50:56.655971 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:50:56.655921 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-699967dd46-jsmdr" podStartSLOduration=1.246035161 podStartE2EDuration="3.655905064s" totalImagesPullingTime="2.409869903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:56.653605351 +0000 UTC m=+341.096439726" watchObservedRunningTime="2026-06-12 21:50:56.655905064 +0000 UTC m=+341.098739437" Jun 12 21:51:09.519741 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:09.519640 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7bpbp" Jun 12 21:51:09.522648 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:09.522624 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-5rfzh" Jun 12 21:51:21.298219 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.298182 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:21.319371 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.319340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:21.319548 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.319435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:21.322448 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.322421 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 21:51:21.323355 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.323333 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 21:51:21.323355 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.323349 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-84tvm\"" Jun 12 21:51:21.396431 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.396398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvf9\" (UniqueName: \"kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9\") pod \"kuadrant-operator-catalog-znnzt\" (UID: \"5da3317e-484f-4fab-910c-4109b45f3f05\") " pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:21.497711 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.497666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvf9\" (UniqueName: \"kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9\") pod \"kuadrant-operator-catalog-znnzt\" (UID: \"5da3317e-484f-4fab-910c-4109b45f3f05\") " pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:21.506539 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.506503 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvf9\" (UniqueName: \"kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9\") pod \"kuadrant-operator-catalog-znnzt\" (UID: \"5da3317e-484f-4fab-910c-4109b45f3f05\") " pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:21.629376 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.629293 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:21.664006 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.663973 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:21.764658 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:21.764634 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:21.767115 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:21.767073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da3317e_484f_4fab_910c_4109b45f3f05.slice/crio-c092db7039ac4fba9d2917983dd4e3f572b8c37f3607ad85d84147e287fded5c WatchSource:0}: Error finding container c092db7039ac4fba9d2917983dd4e3f572b8c37f3607ad85d84147e287fded5c: Status 404 returned error can't find the container with id c092db7039ac4fba9d2917983dd4e3f572b8c37f3607ad85d84147e287fded5c Jun 12 21:51:22.771016 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:22.770972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" event={"ID":"5da3317e-484f-4fab-910c-4109b45f3f05","Type":"ContainerStarted","Data":"c092db7039ac4fba9d2917983dd4e3f572b8c37f3607ad85d84147e287fded5c"} Jun 12 21:51:23.779368 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:23.779169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" event={"ID":"5da3317e-484f-4fab-910c-4109b45f3f05","Type":"ContainerStarted","Data":"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2"} Jun 12 21:51:23.779798 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:23.779368 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" podUID="5da3317e-484f-4fab-910c-4109b45f3f05" containerName="registry-server" containerID="cri-o://81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2" gracePeriod=2 Jun 12 21:51:23.796270 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:23.796213 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" podStartSLOduration=0.922354183 podStartE2EDuration="2.796195155s" totalImagesPullingTime="1.873840972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:23.79387793 +0000 UTC m=+368.236712305" watchObservedRunningTime="2026-06-12 21:51:23.796195155 +0000 UTC m=+368.239029529" Jun 12 21:51:24.022829 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.022806 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-znnzt_5da3317e-484f-4fab-910c-4109b45f3f05/registry-server/0.log" Jun 12 21:51:24.025213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.025193 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:24.117430 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.117396 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpvf9\" (UniqueName: \"kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9\") pod \"5da3317e-484f-4fab-910c-4109b45f3f05\" (UID: \"5da3317e-484f-4fab-910c-4109b45f3f05\") " Jun 12 21:51:24.119944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.119906 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9" (OuterVolumeSpecName: "kube-api-access-rpvf9") pod "5da3317e-484f-4fab-910c-4109b45f3f05" (UID: "5da3317e-484f-4fab-910c-4109b45f3f05"). InnerVolumeSpecName "kube-api-access-rpvf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:24.218557 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.218462 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpvf9\" (UniqueName: \"kubernetes.io/projected/5da3317e-484f-4fab-910c-4109b45f3f05-kube-api-access-rpvf9\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:24.784830 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-znnzt_5da3317e-484f-4fab-910c-4109b45f3f05/registry-server/0.log" Jun 12 21:51:24.785255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784843 2565 generic.go:356] "Generic (PLEG): container finished" podID="5da3317e-484f-4fab-910c-4109b45f3f05" containerID="81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2" exitCode=1 Jun 12 21:51:24.785255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" event={"ID":"5da3317e-484f-4fab-910c-4109b45f3f05","Type":"ContainerDied","Data":"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2"} Jun 12 21:51:24.785255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784907 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" Jun 12 21:51:24.785255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-znnzt" event={"ID":"5da3317e-484f-4fab-910c-4109b45f3f05","Type":"ContainerDied","Data":"c092db7039ac4fba9d2917983dd4e3f572b8c37f3607ad85d84147e287fded5c"} Jun 12 21:51:24.785255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.784983 2565 scope.go:117] "RemoveContainer" containerID="81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2" Jun 12 21:51:24.794043 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.794025 2565 scope.go:117] "RemoveContainer" containerID="81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2" Jun 12 21:51:24.794281 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:51:24.794262 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2\": container with ID starting with 81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2 not found: ID does not exist" containerID="81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2" Jun 12 21:51:24.794328 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.794287 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2"} err="failed to get container status \"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2\": rpc error: code = NotFound desc = could not find container \"81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2\": container with ID starting with 81d0c2d3f0aed90884bdb53948620c7d676469e2ab820b42be81880e905745b2 not found: ID does not exist" Jun 12 21:51:24.805632 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.805605 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:24.809623 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:24.809600 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-znnzt"] Jun 12 21:51:26.065613 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:26.065568 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da3317e-484f-4fab-910c-4109b45f3f05" path="/var/lib/kubelet/pods/5da3317e-484f-4fab-910c-4109b45f3f05/volumes" Jun 12 21:51:37.259487 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.259443 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf"] Jun 12 21:51:37.259965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.259797 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da3317e-484f-4fab-910c-4109b45f3f05" containerName="registry-server" Jun 12 21:51:37.259965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.259810 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da3317e-484f-4fab-910c-4109b45f3f05" containerName="registry-server" Jun 12 21:51:37.259965 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.259876 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da3317e-484f-4fab-910c-4109b45f3f05" containerName="registry-server" Jun 12 21:51:37.262870 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.262851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.265488 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.265467 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xlf77\"" Jun 12 21:51:37.265904 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.265885 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 21:51:37.266437 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.266421 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 21:51:37.273475 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.273447 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf"] Jun 12 21:51:37.331907 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.331866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.332111 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.331912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwnw\" (UniqueName: \"kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.332111 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.332073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.433185 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.433145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.433367 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.433212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.433367 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.433236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwnw\" (UniqueName: \"kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.433574 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.433550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.433625 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.433580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.442109 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.442083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwnw\" (UniqueName: \"kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.573374 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.573276 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:37.718518 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.718483 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf"] Jun 12 21:51:37.720782 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:37.720752 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc381f9d_a960_4475_be92_370a401368f3.slice/crio-c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a WatchSource:0}: Error finding container c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a: Status 404 returned error can't find the container with id c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a Jun 12 21:51:37.847107 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.847077 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6"] Jun 12 21:51:37.850605 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.850582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:37.851889 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.851859 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc381f9d-a960-4475-be92-370a401368f3" containerID="7a52e9acc169d38aa2b21b4c135f740972205a50bb803fef9ad3023080ac87fe" exitCode=0 Jun 12 21:51:37.851999 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.851955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" event={"ID":"dc381f9d-a960-4475-be92-370a401368f3","Type":"ContainerDied","Data":"7a52e9acc169d38aa2b21b4c135f740972205a50bb803fef9ad3023080ac87fe"} Jun 12 21:51:37.851999 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.851988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" event={"ID":"dc381f9d-a960-4475-be92-370a401368f3","Type":"ContainerStarted","Data":"c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a"} Jun 12 21:51:37.859928 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.859900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6"] Jun 12 21:51:37.938563 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.938519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5lq\" (UniqueName: \"kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:37.938803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.938622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:37.938803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:37.938665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.040083 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.040042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.040250 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.040098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.040250 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.040137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5lq\" (UniqueName: \"kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.040516 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.040490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.040606 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.040525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.050657 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.050627 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5lq\" (UniqueName: \"kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.198220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.198136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:38.248054 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.248019 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp"] Jun 12 21:51:38.253076 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.253037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.260559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.260514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp"] Jun 12 21:51:38.340917 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.340891 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6"] Jun 12 21:51:38.343419 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.343376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvs9d\" (UniqueName: \"kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.343556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.343475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.343556 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:38.343486 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c3086b_3bfe_404e_af59_d68cadfba362.slice/crio-3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d WatchSource:0}: Error finding container 3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d: Status 404 returned error can't find the container with id 3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d Jun 12 21:51:38.343556 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.343538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.444701 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.444656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvs9d\" (UniqueName: \"kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.444885 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.444742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.444885 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.444772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.445111 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.445092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.445223 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.445201 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.453477 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.453452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvs9d\" (UniqueName: \"kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.568346 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.568305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:38.650064 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.650033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw"] Jun 12 21:51:38.653586 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.653560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.662253 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.661838 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw"] Jun 12 21:51:38.720423 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.720398 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp"] Jun 12 21:51:38.726782 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:38.726753 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef650c15_31ae_4c31_bedb_006cb7128852.slice/crio-80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff WatchSource:0}: Error finding container 80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff: Status 404 returned error can't find the container with id 80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff Jun 12 21:51:38.747305 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.747282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klc9k\" (UniqueName: \"kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.747399 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.747317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.747399 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.747344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.848090 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.848058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klc9k\" (UniqueName: \"kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.848229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.848104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.848229 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.848135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.848490 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.848469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.848558 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.848504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.859301 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.859200 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc381f9d-a960-4475-be92-370a401368f3" containerID="09f06ac98008e7b88d5bb27b3ae98beb16117482eb54a98931552958dfe0c819" exitCode=0 Jun 12 21:51:38.859301 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.859248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" event={"ID":"dc381f9d-a960-4475-be92-370a401368f3","Type":"ContainerDied","Data":"09f06ac98008e7b88d5bb27b3ae98beb16117482eb54a98931552958dfe0c819"} Jun 12 21:51:38.860500 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.860468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klc9k\" (UniqueName: \"kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:38.861128 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.861038 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef650c15-31ae-4c31-bedb-006cb7128852" containerID="53a1b759b48cbfdc220efb5b6edacd8adfe297a8b1be686c3bf75cf738b832d2" exitCode=0 Jun 12 21:51:38.861128 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.861106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" event={"ID":"ef650c15-31ae-4c31-bedb-006cb7128852","Type":"ContainerDied","Data":"53a1b759b48cbfdc220efb5b6edacd8adfe297a8b1be686c3bf75cf738b832d2"} Jun 12 21:51:38.861260 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.861163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" event={"ID":"ef650c15-31ae-4c31-bedb-006cb7128852","Type":"ContainerStarted","Data":"80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff"} Jun 12 21:51:38.862638 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.862618 2565 generic.go:356] "Generic (PLEG): container finished" podID="27c3086b-3bfe-404e-af59-d68cadfba362" containerID="0acfebe4786e0be2e568ec579b17ce1f11bd0e73328f84236f4e88e7d81405fb" exitCode=0 Jun 12 21:51:38.862775 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.862725 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" event={"ID":"27c3086b-3bfe-404e-af59-d68cadfba362","Type":"ContainerDied","Data":"0acfebe4786e0be2e568ec579b17ce1f11bd0e73328f84236f4e88e7d81405fb"} Jun 12 21:51:38.862775 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.862770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" event={"ID":"27c3086b-3bfe-404e-af59-d68cadfba362","Type":"ContainerStarted","Data":"3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d"} Jun 12 21:51:38.967127 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:38.967092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:39.105534 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.105503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw"] Jun 12 21:51:39.107196 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:39.107169 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecfa7ba_e249_4762_b1dc_d4462fdf644e.slice/crio-d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e WatchSource:0}: Error finding container d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e: Status 404 returned error can't find the container with id d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e Jun 12 21:51:39.870588 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.870558 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc381f9d-a960-4475-be92-370a401368f3" containerID="b99a00490e1e845170dce9d3fda39e2e2df35d73446d89ce5f5b69cb6b3aa306" exitCode=0 Jun 12 21:51:39.870991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.870645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" event={"ID":"dc381f9d-a960-4475-be92-370a401368f3","Type":"ContainerDied","Data":"b99a00490e1e845170dce9d3fda39e2e2df35d73446d89ce5f5b69cb6b3aa306"} Jun 12 21:51:39.872468 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.872445 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef650c15-31ae-4c31-bedb-006cb7128852" containerID="54ae93bdb92672909c25d889c89c6c34abf5a8c2811be1bfa327ace6777729dd" exitCode=0 Jun 12 21:51:39.872573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.872527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" event={"ID":"ef650c15-31ae-4c31-bedb-006cb7128852","Type":"ContainerDied","Data":"54ae93bdb92672909c25d889c89c6c34abf5a8c2811be1bfa327ace6777729dd"} Jun 12 21:51:39.874440 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.874418 2565 generic.go:356] "Generic (PLEG): container finished" podID="27c3086b-3bfe-404e-af59-d68cadfba362" containerID="17a794531ed068e6cd49e930046b951b77250d6b5dffbc8d3e87a2524210d2a2" exitCode=0 Jun 12 21:51:39.874538 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.874500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" event={"ID":"27c3086b-3bfe-404e-af59-d68cadfba362","Type":"ContainerDied","Data":"17a794531ed068e6cd49e930046b951b77250d6b5dffbc8d3e87a2524210d2a2"} Jun 12 21:51:39.876085 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.876064 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerID="ebf1824bb0fbe089bcefe7159d2e81a2df20eb9d145b5ec883505415cf98fe55" exitCode=0 Jun 12 21:51:39.876181 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.876159 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" event={"ID":"0ecfa7ba-e249-4762-b1dc-d4462fdf644e","Type":"ContainerDied","Data":"ebf1824bb0fbe089bcefe7159d2e81a2df20eb9d145b5ec883505415cf98fe55"} Jun 12 21:51:39.876230 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:39.876205 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" event={"ID":"0ecfa7ba-e249-4762-b1dc-d4462fdf644e","Type":"ContainerStarted","Data":"d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e"} Jun 12 21:51:40.883882 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.883850 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef650c15-31ae-4c31-bedb-006cb7128852" containerID="f9bc6a6a959de901f0818ee09208f0f72387c53f7c638eaeb38bb5b43bfeb980" exitCode=0 Jun 12 21:51:40.884310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.883938 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" event={"ID":"ef650c15-31ae-4c31-bedb-006cb7128852","Type":"ContainerDied","Data":"f9bc6a6a959de901f0818ee09208f0f72387c53f7c638eaeb38bb5b43bfeb980"} Jun 12 21:51:40.886124 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.886099 2565 generic.go:356] "Generic (PLEG): container finished" podID="27c3086b-3bfe-404e-af59-d68cadfba362" containerID="84c21863b36f53ef743512165a9bcb706450cbaeb3b4d6f8966dc9392006906b" exitCode=0 Jun 12 21:51:40.886276 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.886191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" event={"ID":"27c3086b-3bfe-404e-af59-d68cadfba362","Type":"ContainerDied","Data":"84c21863b36f53ef743512165a9bcb706450cbaeb3b4d6f8966dc9392006906b"} Jun 12 21:51:40.887994 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.887973 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerID="b61a0e1d3d6ec9ad5106982745b02427ea3520f2d48fe4d72a3d3749186e43c3" exitCode=0 Jun 12 21:51:40.888100 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:40.888055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" event={"ID":"0ecfa7ba-e249-4762-b1dc-d4462fdf644e","Type":"ContainerDied","Data":"b61a0e1d3d6ec9ad5106982745b02427ea3520f2d48fe4d72a3d3749186e43c3"} Jun 12 21:51:41.032569 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.032536 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:41.171344 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.171255 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle\") pod \"dc381f9d-a960-4475-be92-370a401368f3\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " Jun 12 21:51:41.171344 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.171329 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpwnw\" (UniqueName: \"kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw\") pod \"dc381f9d-a960-4475-be92-370a401368f3\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " Jun 12 21:51:41.171542 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.171361 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util\") pod \"dc381f9d-a960-4475-be92-370a401368f3\" (UID: \"dc381f9d-a960-4475-be92-370a401368f3\") " Jun 12 21:51:41.171877 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.171855 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle" (OuterVolumeSpecName: "bundle") pod "dc381f9d-a960-4475-be92-370a401368f3" (UID: "dc381f9d-a960-4475-be92-370a401368f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:41.173622 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.173600 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw" (OuterVolumeSpecName: "kube-api-access-vpwnw") pod "dc381f9d-a960-4475-be92-370a401368f3" (UID: "dc381f9d-a960-4475-be92-370a401368f3"). InnerVolumeSpecName "kube-api-access-vpwnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:41.177249 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.177226 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util" (OuterVolumeSpecName: "util") pod "dc381f9d-a960-4475-be92-370a401368f3" (UID: "dc381f9d-a960-4475-be92-370a401368f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:41.272107 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.272075 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:41.272107 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.272105 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpwnw\" (UniqueName: \"kubernetes.io/projected/dc381f9d-a960-4475-be92-370a401368f3-kube-api-access-vpwnw\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:41.272107 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.272116 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc381f9d-a960-4475-be92-370a401368f3-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:41.895014 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.894987 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" Jun 12 21:51:41.895014 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.894999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf" event={"ID":"dc381f9d-a960-4475-be92-370a401368f3","Type":"ContainerDied","Data":"c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a"} Jun 12 21:51:41.895506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.895046 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c22bd4575fadf3bb80d99924ec17e9853d7d4e5f9d3d8281344cd3168da0261a" Jun 12 21:51:41.897189 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.897161 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerID="60cc73bd1f7c110bd3183f44aa5ee9f4a4131163f8571beb1cc68ff6359863d6" exitCode=0 Jun 12 21:51:41.897309 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:41.897195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" event={"ID":"0ecfa7ba-e249-4762-b1dc-d4462fdf644e","Type":"ContainerDied","Data":"60cc73bd1f7c110bd3183f44aa5ee9f4a4131163f8571beb1cc68ff6359863d6"} Jun 12 21:51:42.058509 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.058487 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:42.060635 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.060615 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:42.178418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178319 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle\") pod \"ef650c15-31ae-4c31-bedb-006cb7128852\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " Jun 12 21:51:42.178418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178406 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp5lq\" (UniqueName: \"kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq\") pod \"27c3086b-3bfe-404e-af59-d68cadfba362\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " Jun 12 21:51:42.178418 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178427 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util\") pod \"27c3086b-3bfe-404e-af59-d68cadfba362\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " Jun 12 21:51:42.178665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178470 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvs9d\" (UniqueName: \"kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d\") pod \"ef650c15-31ae-4c31-bedb-006cb7128852\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " Jun 12 21:51:42.178665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178560 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util\") pod \"ef650c15-31ae-4c31-bedb-006cb7128852\" (UID: \"ef650c15-31ae-4c31-bedb-006cb7128852\") " Jun 12 21:51:42.178665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.178600 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle\") pod \"27c3086b-3bfe-404e-af59-d68cadfba362\" (UID: \"27c3086b-3bfe-404e-af59-d68cadfba362\") " Jun 12 21:51:42.179266 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.179100 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle" (OuterVolumeSpecName: "bundle") pod "ef650c15-31ae-4c31-bedb-006cb7128852" (UID: "ef650c15-31ae-4c31-bedb-006cb7128852"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:42.179266 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.179176 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle" (OuterVolumeSpecName: "bundle") pod "27c3086b-3bfe-404e-af59-d68cadfba362" (UID: "27c3086b-3bfe-404e-af59-d68cadfba362"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:42.181506 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.181485 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq" (OuterVolumeSpecName: "kube-api-access-fp5lq") pod "27c3086b-3bfe-404e-af59-d68cadfba362" (UID: "27c3086b-3bfe-404e-af59-d68cadfba362"). InnerVolumeSpecName "kube-api-access-fp5lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:42.181624 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.181513 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d" (OuterVolumeSpecName: "kube-api-access-nvs9d") pod "ef650c15-31ae-4c31-bedb-006cb7128852" (UID: "ef650c15-31ae-4c31-bedb-006cb7128852"). InnerVolumeSpecName "kube-api-access-nvs9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:42.184321 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.184284 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util" (OuterVolumeSpecName: "util") pod "ef650c15-31ae-4c31-bedb-006cb7128852" (UID: "ef650c15-31ae-4c31-bedb-006cb7128852"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:42.185269 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.185242 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util" (OuterVolumeSpecName: "util") pod "27c3086b-3bfe-404e-af59-d68cadfba362" (UID: "27c3086b-3bfe-404e-af59-d68cadfba362"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:42.280051 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280006 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.280051 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280047 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.280051 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280055 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef650c15-31ae-4c31-bedb-006cb7128852-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.280051 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280063 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp5lq\" (UniqueName: \"kubernetes.io/projected/27c3086b-3bfe-404e-af59-d68cadfba362-kube-api-access-fp5lq\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.280051 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280072 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c3086b-3bfe-404e-af59-d68cadfba362-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.280337 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.280081 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvs9d\" (UniqueName: \"kubernetes.io/projected/ef650c15-31ae-4c31-bedb-006cb7128852-kube-api-access-nvs9d\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:42.903940 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.903913 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" Jun 12 21:51:42.904325 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.903908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp" event={"ID":"ef650c15-31ae-4c31-bedb-006cb7128852","Type":"ContainerDied","Data":"80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff"} Jun 12 21:51:42.904325 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.904069 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80b0f9d2e295a40e0bb4a67bf4ac4bfd525cca423d53c05fba2ff8591c5116ff" Jun 12 21:51:42.905872 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.905851 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" Jun 12 21:51:42.906022 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.905881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6" event={"ID":"27c3086b-3bfe-404e-af59-d68cadfba362","Type":"ContainerDied","Data":"3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d"} Jun 12 21:51:42.906022 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:42.905915 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3edc75c2dcb2db4332f38bd99e2419e2f89d8c6323b8f4d0a7e01e77f2deb02d" Jun 12 21:51:43.040908 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.040878 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:43.188450 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.188352 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klc9k\" (UniqueName: \"kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k\") pod \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " Jun 12 21:51:43.188628 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.188454 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle\") pod \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " Jun 12 21:51:43.188628 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.188498 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util\") pod \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\" (UID: \"0ecfa7ba-e249-4762-b1dc-d4462fdf644e\") " Jun 12 21:51:43.189146 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.189115 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle" (OuterVolumeSpecName: "bundle") pod "0ecfa7ba-e249-4762-b1dc-d4462fdf644e" (UID: "0ecfa7ba-e249-4762-b1dc-d4462fdf644e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:43.190784 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.190762 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k" (OuterVolumeSpecName: "kube-api-access-klc9k") pod "0ecfa7ba-e249-4762-b1dc-d4462fdf644e" (UID: "0ecfa7ba-e249-4762-b1dc-d4462fdf644e"). InnerVolumeSpecName "kube-api-access-klc9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:43.196323 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.196296 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util" (OuterVolumeSpecName: "util") pod "0ecfa7ba-e249-4762-b1dc-d4462fdf644e" (UID: "0ecfa7ba-e249-4762-b1dc-d4462fdf644e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:51:43.289702 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.289662 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:43.289879 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.289719 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klc9k\" (UniqueName: \"kubernetes.io/projected/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-kube-api-access-klc9k\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:43.289879 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.289730 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ecfa7ba-e249-4762-b1dc-d4462fdf644e-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:51:43.913255 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.913223 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" Jun 12 21:51:43.913635 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.913226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw" event={"ID":"0ecfa7ba-e249-4762-b1dc-d4462fdf644e","Type":"ContainerDied","Data":"d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e"} Jun 12 21:51:43.913635 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:43.913353 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d00137b035f84ad9e89ce07bf930b43f68638f758d4168b44bf2ec01d0a1f60e" Jun 12 21:51:55.266957 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.266914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb"] Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267249 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267261 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267278 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267291 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267298 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267303 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267312 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267317 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267323 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="extract" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267328 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="extract" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267335 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267340 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="pull" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267345 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="extract" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267349 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="extract" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267354 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267359 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267367 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="util" Jun 12 21:51:55.267362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267372 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="util" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267380 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267385 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267392 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267397 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267444 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef650c15-31ae-4c31-bedb-006cb7128852" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267452 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc381f9d-a960-4475-be92-370a401368f3" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267457 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c3086b-3bfe-404e-af59-d68cadfba362" containerName="extract" Jun 12 21:51:55.267944 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.267463 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ecfa7ba-e249-4762-b1dc-d4462fdf644e" containerName="extract" Jun 12 21:51:55.271479 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.271463 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.274079 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.274055 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 21:51:55.274079 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.274076 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 21:51:55.274512 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.274495 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2ttt\"" Jun 12 21:51:55.285968 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.285942 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb"] Jun 12 21:51:55.400376 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.400319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.400528 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.400388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88sjr\" (UniqueName: \"kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.501749 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.501682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88sjr\" (UniqueName: \"kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.501946 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.501837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.502208 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.502187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.520867 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.520800 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88sjr\" (UniqueName: \"kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.582850 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.582817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:51:55.752576 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.752551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb"] Jun 12 21:51:55.755810 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:51:55.755783 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006590fc_82b0_44ef_b0a1_cc68e0393916.slice/crio-dd3c3426a9b646314081cc01f3da2d562f6d2957518ec8fe9eac884e5c0db356 WatchSource:0}: Error finding container dd3c3426a9b646314081cc01f3da2d562f6d2957518ec8fe9eac884e5c0db356: Status 404 returned error can't find the container with id dd3c3426a9b646314081cc01f3da2d562f6d2957518ec8fe9eac884e5c0db356 Jun 12 21:51:55.980362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:51:55.980275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" event={"ID":"006590fc-82b0-44ef-b0a1-cc68e0393916","Type":"ContainerStarted","Data":"dd3c3426a9b646314081cc01f3da2d562f6d2957518ec8fe9eac884e5c0db356"} Jun 12 21:52:02.019038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:02.018998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" event={"ID":"006590fc-82b0-44ef-b0a1-cc68e0393916","Type":"ContainerStarted","Data":"7210aaff8b46a93117e2ad0a94b0008abb44f3d9d8de616dd77d38c80a197fde"} Jun 12 21:52:02.019455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:02.019074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:02.047793 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:02.047740 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" podStartSLOduration=1.250227135 podStartE2EDuration="7.047722852s" totalImagesPullingTime="5.797495717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:02.045974598 +0000 UTC m=+406.488808973" watchObservedRunningTime="2026-06-12 21:52:02.047722852 +0000 UTC m=+406.490557226" Jun 12 21:52:13.027441 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:13.027408 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:14.908483 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:14.908445 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb"] Jun 12 21:52:14.908946 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:14.908648 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" containerName="manager" containerID="cri-o://7210aaff8b46a93117e2ad0a94b0008abb44f3d9d8de616dd77d38c80a197fde" gracePeriod=2 Jun 12 21:52:14.924760 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:14.924724 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb"] Jun 12 21:52:15.024064 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.024034 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5"] Jun 12 21:52:15.024601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.024575 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" containerName="manager" Jun 12 21:52:15.024746 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.024605 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" containerName="manager" Jun 12 21:52:15.024813 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.024753 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" containerName="manager" Jun 12 21:52:15.028220 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.028195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:15.044967 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:52:15.044926 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" is forbidden: User \"system:node:ip-10-0-142-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-94.ec2.internal' and this object" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:15.045899 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.045671 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gsqf7\"" Jun 12 21:52:15.048837 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.048813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5"] Jun 12 21:52:15.061163 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.061103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vm7\" (UniqueName: \"kubernetes.io/projected/f1537090-b623-4979-a5d1-2bd7f5d24ddd-kube-api-access-t8vm7\") pod \"limitador-operator-controller-manager-859d7b78bd-7g5t5\" (UID: \"f1537090-b623-4979-a5d1-2bd7f5d24ddd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:15.098023 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.097989 2565 generic.go:356] "Generic (PLEG): container finished" podID="006590fc-82b0-44ef-b0a1-cc68e0393916" containerID="7210aaff8b46a93117e2ad0a94b0008abb44f3d9d8de616dd77d38c80a197fde" exitCode=0 Jun 12 21:52:15.155464 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.155437 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:15.160432 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:52:15.160379 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" is forbidden: User \"system:node:ip-10-0-142-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-94.ec2.internal' and this object" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:15.161661 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.161641 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88sjr\" (UniqueName: \"kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr\") pod \"006590fc-82b0-44ef-b0a1-cc68e0393916\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " Jun 12 21:52:15.161731 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.161720 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume\") pod \"006590fc-82b0-44ef-b0a1-cc68e0393916\" (UID: \"006590fc-82b0-44ef-b0a1-cc68e0393916\") " Jun 12 21:52:15.161910 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.161892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vm7\" (UniqueName: \"kubernetes.io/projected/f1537090-b623-4979-a5d1-2bd7f5d24ddd-kube-api-access-t8vm7\") pod \"limitador-operator-controller-manager-859d7b78bd-7g5t5\" (UID: \"f1537090-b623-4979-a5d1-2bd7f5d24ddd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:15.162200 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.162177 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "006590fc-82b0-44ef-b0a1-cc68e0393916" (UID: "006590fc-82b0-44ef-b0a1-cc68e0393916"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:52:15.163753 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.163727 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr" (OuterVolumeSpecName: "kube-api-access-88sjr") pod "006590fc-82b0-44ef-b0a1-cc68e0393916" (UID: "006590fc-82b0-44ef-b0a1-cc68e0393916"). InnerVolumeSpecName "kube-api-access-88sjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:52:15.182646 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.182617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vm7\" (UniqueName: \"kubernetes.io/projected/f1537090-b623-4979-a5d1-2bd7f5d24ddd-kube-api-access-t8vm7\") pod \"limitador-operator-controller-manager-859d7b78bd-7g5t5\" (UID: \"f1537090-b623-4979-a5d1-2bd7f5d24ddd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:15.262759 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.262717 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88sjr\" (UniqueName: \"kubernetes.io/projected/006590fc-82b0-44ef-b0a1-cc68e0393916-kube-api-access-88sjr\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:52:15.262759 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.262749 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/006590fc-82b0-44ef-b0a1-cc68e0393916-extensions-socket-volume\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:52:15.342934 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.342875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:15.523348 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:15.523322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5"] Jun 12 21:52:15.525509 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:52:15.525487 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1537090_b623_4979_a5d1_2bd7f5d24ddd.slice/crio-b0e0cd7ff77e0ebcd32ce66e6eaa29f08b942b1f1ae1221303dcf21e6318e4c6 WatchSource:0}: Error finding container b0e0cd7ff77e0ebcd32ce66e6eaa29f08b942b1f1ae1221303dcf21e6318e4c6: Status 404 returned error can't find the container with id b0e0cd7ff77e0ebcd32ce66e6eaa29f08b942b1f1ae1221303dcf21e6318e4c6 Jun 12 21:52:16.065916 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:52:16.065873 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fz4sb\" is forbidden: User \"system:node:ip-10-0-142-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-94.ec2.internal' and this object" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:16.068213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.067570 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006590fc-82b0-44ef-b0a1-cc68e0393916" path="/var/lib/kubelet/pods/006590fc-82b0-44ef-b0a1-cc68e0393916/volumes" Jun 12 21:52:16.106288 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.106251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" event={"ID":"f1537090-b623-4979-a5d1-2bd7f5d24ddd","Type":"ContainerStarted","Data":"b0e0cd7ff77e0ebcd32ce66e6eaa29f08b942b1f1ae1221303dcf21e6318e4c6"} Jun 12 21:52:16.107800 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.107770 2565 scope.go:117] "RemoveContainer" containerID="7210aaff8b46a93117e2ad0a94b0008abb44f3d9d8de616dd77d38c80a197fde" Jun 12 21:52:16.107936 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.107810 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fz4sb" Jun 12 21:52:16.614085 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.614046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 21:52:16.619093 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.619067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.628324 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.628135 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2ttt\"" Jun 12 21:52:16.636782 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.636752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 21:52:16.675596 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.675555 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7nr\" (UniqueName: \"kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.675761 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.675604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.777038 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.776991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7nr\" (UniqueName: \"kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.777219 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.777055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.777417 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.777394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.788835 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.788800 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7nr\" (UniqueName: \"kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr\") pod \"kuadrant-operator-controller-manager-86878c769f-p9l75\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:16.932354 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:16.932255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:17.115991 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:17.115964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" event={"ID":"f1537090-b623-4979-a5d1-2bd7f5d24ddd","Type":"ContainerStarted","Data":"f7575f5314671c9985f5641e44bb38fa019faa6e58f015ae16796a3eb7cc8698"} Jun 12 21:52:17.116233 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:17.116027 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:17.116233 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:17.116074 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 21:52:17.118558 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:52:17.118534 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaf22ca_9fbb_4280_ab64_c0f2c92e2408.slice/crio-2e8960caaea4fc42c19ebde8dc52eed4700f38ca924eee7907e0ba845b1bc99e WatchSource:0}: Error finding container 2e8960caaea4fc42c19ebde8dc52eed4700f38ca924eee7907e0ba845b1bc99e: Status 404 returned error can't find the container with id 2e8960caaea4fc42c19ebde8dc52eed4700f38ca924eee7907e0ba845b1bc99e Jun 12 21:52:17.137856 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:17.137798 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" podStartSLOduration=1.636335493 podStartE2EDuration="3.137776861s" totalImagesPullingTime="1.501441368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:17.137184172 +0000 UTC m=+421.580018548" watchObservedRunningTime="2026-06-12 21:52:17.137776861 +0000 UTC m=+421.580611236" Jun 12 21:52:18.124959 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:18.124917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" event={"ID":"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408","Type":"ContainerStarted","Data":"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed"} Jun 12 21:52:18.125432 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:18.124978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" event={"ID":"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408","Type":"ContainerStarted","Data":"2e8960caaea4fc42c19ebde8dc52eed4700f38ca924eee7907e0ba845b1bc99e"} Jun 12 21:52:18.167609 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:18.167545 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" podStartSLOduration=2.167528906 podStartE2EDuration="2.167528906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:18.163779749 +0000 UTC m=+422.606614123" watchObservedRunningTime="2026-06-12 21:52:18.167528906 +0000 UTC m=+422.610363280" Jun 12 21:52:19.130614 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:19.130581 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:52:28.127841 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:28.127810 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7g5t5" Jun 12 21:52:30.138913 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:52:30.138878 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 21:53:20.248564 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.248521 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x"] Jun 12 21:53:20.252319 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.252300 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.255405 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.255384 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp2qp\"" Jun 12 21:53:20.255647 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.255630 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 21:53:20.256323 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.256306 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 21:53:20.262361 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.262340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x"] Jun 12 21:53:20.324561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.324523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.324561 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.324568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtxzl\" (UniqueName: \"kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.324798 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.324613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.425850 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.425811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.426022 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.425861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtxzl\" (UniqueName: \"kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.426022 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.425975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.426215 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.426198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.426306 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.426290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.435169 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.435146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtxzl\" (UniqueName: \"kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.562529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.562442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:20.703899 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:20.703869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x"] Jun 12 21:53:20.705495 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:53:20.705460 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76ecaaf_cfb5_47e3_ae34_07eb255f3289.slice/crio-d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b WatchSource:0}: Error finding container d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b: Status 404 returned error can't find the container with id d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b Jun 12 21:53:21.488662 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:21.488627 2565 generic.go:356] "Generic (PLEG): container finished" podID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerID="07d68441d9acf2b4196bfcca9af4b7db409864d86d2ec8838ab1eba3ead97a0d" exitCode=0 Jun 12 21:53:21.489088 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:21.488716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" event={"ID":"d76ecaaf-cfb5-47e3-ae34-07eb255f3289","Type":"ContainerDied","Data":"07d68441d9acf2b4196bfcca9af4b7db409864d86d2ec8838ab1eba3ead97a0d"} Jun 12 21:53:21.489088 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:21.488791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" event={"ID":"d76ecaaf-cfb5-47e3-ae34-07eb255f3289","Type":"ContainerStarted","Data":"d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b"} Jun 12 21:53:22.495835 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:22.495803 2565 generic.go:356] "Generic (PLEG): container finished" podID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerID="102a2306d656c933b3787d29b91cc88cb226bd211683469b8a185ad0cef7c1a7" exitCode=0 Jun 12 21:53:22.496206 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:22.495898 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" event={"ID":"d76ecaaf-cfb5-47e3-ae34-07eb255f3289","Type":"ContainerDied","Data":"102a2306d656c933b3787d29b91cc88cb226bd211683469b8a185ad0cef7c1a7"} Jun 12 21:53:23.503254 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:23.503217 2565 generic.go:356] "Generic (PLEG): container finished" podID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerID="7e0bae8c22e176cf3889853311f88423815f2f557cc5b96ddabfb170f9b3fc70" exitCode=0 Jun 12 21:53:23.503629 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:23.503309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" event={"ID":"d76ecaaf-cfb5-47e3-ae34-07eb255f3289","Type":"ContainerDied","Data":"7e0bae8c22e176cf3889853311f88423815f2f557cc5b96ddabfb170f9b3fc70"} Jun 12 21:53:24.650355 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.650329 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:24.764021 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.763936 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle\") pod \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " Jun 12 21:53:24.764021 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.763975 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util\") pod \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " Jun 12 21:53:24.764021 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.763996 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtxzl\" (UniqueName: \"kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl\") pod \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\" (UID: \"d76ecaaf-cfb5-47e3-ae34-07eb255f3289\") " Jun 12 21:53:24.764497 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.764472 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle" (OuterVolumeSpecName: "bundle") pod "d76ecaaf-cfb5-47e3-ae34-07eb255f3289" (UID: "d76ecaaf-cfb5-47e3-ae34-07eb255f3289"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:53:24.766300 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.766271 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl" (OuterVolumeSpecName: "kube-api-access-qtxzl") pod "d76ecaaf-cfb5-47e3-ae34-07eb255f3289" (UID: "d76ecaaf-cfb5-47e3-ae34-07eb255f3289"). InnerVolumeSpecName "kube-api-access-qtxzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:53:24.769578 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.769553 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util" (OuterVolumeSpecName: "util") pod "d76ecaaf-cfb5-47e3-ae34-07eb255f3289" (UID: "d76ecaaf-cfb5-47e3-ae34-07eb255f3289"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:53:24.865456 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.865425 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-bundle\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:53:24.865456 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.865450 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-util\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:53:24.865456 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:24.865459 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtxzl\" (UniqueName: \"kubernetes.io/projected/d76ecaaf-cfb5-47e3-ae34-07eb255f3289-kube-api-access-qtxzl\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:53:25.515589 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:25.515552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" event={"ID":"d76ecaaf-cfb5-47e3-ae34-07eb255f3289","Type":"ContainerDied","Data":"d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b"} Jun 12 21:53:25.515589 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:25.515590 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w759x" Jun 12 21:53:25.515871 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:25.515603 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d48d0a82dd74ca801a4d394ae293dc0e7fd7b9a2b536c90e4cc0bd45584cb30b" Jun 12 21:53:43.004910 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.004878 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005234 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="pull" Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005247 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="pull" Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005255 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="extract" Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005263 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="extract" Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="util" Jun 12 21:53:43.005331 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005278 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="util" Jun 12 21:53:43.005516 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.005356 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76ecaaf-cfb5-47e3-ae34-07eb255f3289" containerName="extract" Jun 12 21:53:43.008381 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.008363 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:43.010779 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.010748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 21:53:43.011601 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.011588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8n7md\"" Jun 12 21:53:43.011665 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.011613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 21:53:43.012243 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.012221 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 21:53:43.018714 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.018671 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:53:43.127029 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.126990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p\") pod \"maas-keycloak-0\" (UID: \"caf06199-8fa8-4df6-9bf7-076aa7f25352\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:43.227844 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.227813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p\") pod \"maas-keycloak-0\" (UID: \"caf06199-8fa8-4df6-9bf7-076aa7f25352\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:43.248140 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.248112 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p\") pod \"maas-keycloak-0\" (UID: \"caf06199-8fa8-4df6-9bf7-076aa7f25352\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:43.319223 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.319127 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:43.471778 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.471748 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:53:43.473562 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:53:43.473524 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf06199_8fa8_4df6_9bf7_076aa7f25352.slice/crio-785f00c79ed29fe23222e2d1f4c7021a0cbcaf7a765d45dc3eea5e87f5007ac8 WatchSource:0}: Error finding container 785f00c79ed29fe23222e2d1f4c7021a0cbcaf7a765d45dc3eea5e87f5007ac8: Status 404 returned error can't find the container with id 785f00c79ed29fe23222e2d1f4c7021a0cbcaf7a765d45dc3eea5e87f5007ac8 Jun 12 21:53:43.623322 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:43.623221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"caf06199-8fa8-4df6-9bf7-076aa7f25352","Type":"ContainerStarted","Data":"785f00c79ed29fe23222e2d1f4c7021a0cbcaf7a765d45dc3eea5e87f5007ac8"} Jun 12 21:53:48.661455 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:48.661410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"caf06199-8fa8-4df6-9bf7-076aa7f25352","Type":"ContainerStarted","Data":"7814fdfcbbcfd06cae5dac95ba713f8473a1272d1a2ee39f62abb68b3463044f"} Jun 12 21:53:48.700021 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:48.699947 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.633855984 podStartE2EDuration="6.699919586s" totalImagesPullingTime="5.066063602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:53:48.696952306 +0000 UTC m=+513.139786662" watchObservedRunningTime="2026-06-12 21:53:48.699919586 +0000 UTC m=+513.142753967" Jun 12 21:53:49.319788 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:49.319750 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:49.321812 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:49.321779 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:50.320042 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:50.319981 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:51.319922 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:51.319874 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:52.319872 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:52.319819 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:53.320772 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:53.320662 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:53.321304 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:53.321191 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 21:53:54.320317 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:54.320271 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:55.319932 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:55.319877 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:56.320081 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:56.320017 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:57.320617 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:57.320568 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:58.319713 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:58.319651 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:53:59.320488 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:53:59.320426 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:54:00.320291 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:00.320241 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 12 21:54:01.422873 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:01.422522 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 21:54:01.442009 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:01.441962 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 21:54:11.428735 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:11.428678 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 21:54:17.527675 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.527640 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:17.590260 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.590217 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:17.590449 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.590351 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.593611 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.593592 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 21:54:17.593770 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.593594 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 21:54:17.593770 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.593592 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-drtz4\"" Jun 12 21:54:17.659332 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.659300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdd6c\" (UniqueName: \"kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.659500 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.659339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.728141 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.728101 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 21:54:17.754554 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.754516 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 21:54:17.754748 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.754625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.759814 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.759788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.759984 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.759922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdd6c\" (UniqueName: \"kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.762894 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.762863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.776106 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.776078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdd6c\" (UniqueName: \"kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c\") pod \"maas-controller-79f7cd59b9-xrkxf\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.860504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.860410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.860504 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.860464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwcq\" (UniqueName: \"kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.900347 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.900309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:17.961875 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.961840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.962017 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.961899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvwcq\" (UniqueName: \"kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.964462 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.964437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:17.970325 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:17.970274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvwcq\" (UniqueName: \"kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq\") pod \"maas-controller-bd5757487-fb6ml\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:18.061032 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:54:18.061004 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846827eb_4fc9_42d0_a62c_c087647380cb.slice/crio-2f14573b57c1bd85dbee900dacf870f6ab591ece4a6485c48ed933ccd194a9f6 WatchSource:0}: Error finding container 2f14573b57c1bd85dbee900dacf870f6ab591ece4a6485c48ed933ccd194a9f6: Status 404 returned error can't find the container with id 2f14573b57c1bd85dbee900dacf870f6ab591ece4a6485c48ed933ccd194a9f6 Jun 12 21:54:18.066451 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:18.066428 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:18.075138 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:18.075112 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:18.237284 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:18.237257 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 21:54:18.238021 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:54:18.237991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56a758f_fd04_416c_b9b4_141fc49646f6.slice/crio-212426fec351a1288666ef085ff84bda0e1e1055e5a28c5f966709c4c5a4ba6e WatchSource:0}: Error finding container 212426fec351a1288666ef085ff84bda0e1e1055e5a28c5f966709c4c5a4ba6e: Status 404 returned error can't find the container with id 212426fec351a1288666ef085ff84bda0e1e1055e5a28c5f966709c4c5a4ba6e Jun 12 21:54:18.885187 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:18.885146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd5757487-fb6ml" event={"ID":"c56a758f-fd04-416c-b9b4-141fc49646f6","Type":"ContainerStarted","Data":"212426fec351a1288666ef085ff84bda0e1e1055e5a28c5f966709c4c5a4ba6e"} Jun 12 21:54:18.887238 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:18.887170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" event={"ID":"846827eb-4fc9-42d0-a62c-c087647380cb","Type":"ContainerStarted","Data":"2f14573b57c1bd85dbee900dacf870f6ab591ece4a6485c48ed933ccd194a9f6"} Jun 12 21:54:20.901543 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.901508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd5757487-fb6ml" event={"ID":"c56a758f-fd04-416c-b9b4-141fc49646f6","Type":"ContainerStarted","Data":"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd"} Jun 12 21:54:20.902026 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.901608 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:20.903993 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.903353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" event={"ID":"846827eb-4fc9-42d0-a62c-c087647380cb","Type":"ContainerStarted","Data":"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f"} Jun 12 21:54:20.903993 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.903611 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:20.943068 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.943013 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bd5757487-fb6ml" podStartSLOduration=1.448390864 podStartE2EDuration="3.942991656s" totalImagesPullingTime="2.494600792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:54:20.941201231 +0000 UTC m=+545.384035607" watchObservedRunningTime="2026-06-12 21:54:20.942991656 +0000 UTC m=+545.385826061" Jun 12 21:54:20.966470 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:20.966410 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" podStartSLOduration=1.299459553 podStartE2EDuration="3.966390787s" totalImagesPullingTime="2.666931234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:54:20.965653443 +0000 UTC m=+545.408487814" watchObservedRunningTime="2026-06-12 21:54:20.966390787 +0000 UTC m=+545.409225162" Jun 12 21:54:31.914399 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:31.914364 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:31.914950 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:31.914657 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 21:54:31.994525 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:31.994489 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:31.994722 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:31.994679 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" podUID="846827eb-4fc9-42d0-a62c-c087647380cb" containerName="manager" containerID="cri-o://afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f" gracePeriod=30 Jun 12 21:54:32.240014 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.239989 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:32.387186 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.387152 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert\") pod \"846827eb-4fc9-42d0-a62c-c087647380cb\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " Jun 12 21:54:32.387378 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.387260 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdd6c\" (UniqueName: \"kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c\") pod \"846827eb-4fc9-42d0-a62c-c087647380cb\" (UID: \"846827eb-4fc9-42d0-a62c-c087647380cb\") " Jun 12 21:54:32.389574 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.389547 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "846827eb-4fc9-42d0-a62c-c087647380cb" (UID: "846827eb-4fc9-42d0-a62c-c087647380cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:54:32.389681 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.389570 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c" (OuterVolumeSpecName: "kube-api-access-qdd6c") pod "846827eb-4fc9-42d0-a62c-c087647380cb" (UID: "846827eb-4fc9-42d0-a62c-c087647380cb"). InnerVolumeSpecName "kube-api-access-qdd6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:54:32.488394 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.488366 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdd6c\" (UniqueName: \"kubernetes.io/projected/846827eb-4fc9-42d0-a62c-c087647380cb-kube-api-access-qdd6c\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:54:32.488394 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.488395 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/846827eb-4fc9-42d0-a62c-c087647380cb-webhook-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:54:32.971204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.971107 2565 generic.go:356] "Generic (PLEG): container finished" podID="846827eb-4fc9-42d0-a62c-c087647380cb" containerID="afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f" exitCode=0 Jun 12 21:54:32.971204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.971151 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" Jun 12 21:54:32.971204 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.971190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" event={"ID":"846827eb-4fc9-42d0-a62c-c087647380cb","Type":"ContainerDied","Data":"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f"} Jun 12 21:54:32.971792 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.971246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd59b9-xrkxf" event={"ID":"846827eb-4fc9-42d0-a62c-c087647380cb","Type":"ContainerDied","Data":"2f14573b57c1bd85dbee900dacf870f6ab591ece4a6485c48ed933ccd194a9f6"} Jun 12 21:54:32.971792 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.971277 2565 scope.go:117] "RemoveContainer" containerID="afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f" Jun 12 21:54:32.987188 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.987165 2565 scope.go:117] "RemoveContainer" containerID="afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f" Jun 12 21:54:32.987467 ip-10-0-142-94 kubenswrapper[2565]: E0612 21:54:32.987440 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f\": container with ID starting with afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f not found: ID does not exist" containerID="afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f" Jun 12 21:54:32.987535 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.987472 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f"} err="failed to get container status \"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f\": rpc error: code = NotFound desc = could not find container \"afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f\": container with ID starting with afae1139208d08f05c97f571f5b3352a2a9071ab24021c4f4583be298c6cac1f not found: ID does not exist" Jun 12 21:54:32.999588 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:32.999567 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:33.004882 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:33.004862 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79f7cd59b9-xrkxf"] Jun 12 21:54:34.064209 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:34.064175 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846827eb-4fc9-42d0-a62c-c087647380cb" path="/var/lib/kubelet/pods/846827eb-4fc9-42d0-a62c-c087647380cb/volumes" Jun 12 21:54:50.578920 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.578884 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4tgcw"] Jun 12 21:54:50.579311 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.579288 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846827eb-4fc9-42d0-a62c-c087647380cb" containerName="manager" Jun 12 21:54:50.579311 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.579301 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="846827eb-4fc9-42d0-a62c-c087647380cb" containerName="manager" Jun 12 21:54:50.579383 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.579373 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="846827eb-4fc9-42d0-a62c-c087647380cb" containerName="manager" Jun 12 21:54:50.582502 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.582482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:50.585123 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.585081 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 21:54:50.585616 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.585601 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v6xtz\"" Jun 12 21:54:50.593175 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.593141 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4tgcw"] Jun 12 21:54:50.650119 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.650074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c7xj\" (UniqueName: \"kubernetes.io/projected/d5ddb67e-cfe5-4257-bfde-e9214fde12d0-kube-api-access-5c7xj\") pod \"payload-processing-699b6cd6c-4tgcw\" (UID: \"d5ddb67e-cfe5-4257-bfde-e9214fde12d0\") " pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:50.751226 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.751187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7xj\" (UniqueName: \"kubernetes.io/projected/d5ddb67e-cfe5-4257-bfde-e9214fde12d0-kube-api-access-5c7xj\") pod \"payload-processing-699b6cd6c-4tgcw\" (UID: \"d5ddb67e-cfe5-4257-bfde-e9214fde12d0\") " pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:50.759572 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.759533 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c7xj\" (UniqueName: \"kubernetes.io/projected/d5ddb67e-cfe5-4257-bfde-e9214fde12d0-kube-api-access-5c7xj\") pod \"payload-processing-699b6cd6c-4tgcw\" (UID: \"d5ddb67e-cfe5-4257-bfde-e9214fde12d0\") " pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:50.895365 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:50.895283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:51.053786 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:51.053756 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4tgcw"] Jun 12 21:54:51.055279 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:54:51.055249 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ddb67e_cfe5_4257_bfde_e9214fde12d0.slice/crio-de12b715022a50eea325d32a236568d9aadf5889633ad512fd83dd0af7e578fd WatchSource:0}: Error finding container de12b715022a50eea325d32a236568d9aadf5889633ad512fd83dd0af7e578fd: Status 404 returned error can't find the container with id de12b715022a50eea325d32a236568d9aadf5889633ad512fd83dd0af7e578fd Jun 12 21:54:51.081491 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:51.081456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" event={"ID":"d5ddb67e-cfe5-4257-bfde-e9214fde12d0","Type":"ContainerStarted","Data":"de12b715022a50eea325d32a236568d9aadf5889633ad512fd83dd0af7e578fd"} Jun 12 21:54:54.101115 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:54.101075 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" event={"ID":"d5ddb67e-cfe5-4257-bfde-e9214fde12d0","Type":"ContainerStarted","Data":"7aceced5220e29fed8bc97aa9c5006fd7b075d1aa69b49ffd1e183a8b13a28c3"} Jun 12 21:54:54.101600 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:54.101269 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:54:54.119580 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:54:54.119531 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" podStartSLOduration=1.9993558 podStartE2EDuration="4.119516575s" totalImagesPullingTime="2.120160775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:54:54.117482638 +0000 UTC m=+578.560317014" watchObservedRunningTime="2026-06-12 21:54:54.119516575 +0000 UTC m=+578.562350949" Jun 12 21:55:05.108330 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:55:05.108287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-4tgcw" Jun 12 21:55:16.044380 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:55:16.044351 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:55:16.044864 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:55:16.044631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 21:57:05.075014 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:05.074926 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:05.075569 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:05.075156 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" containerID="cri-o://7814fdfcbbcfd06cae5dac95ba713f8473a1272d1a2ee39f62abb68b3463044f" gracePeriod=30 Jun 12 21:57:06.862241 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:06.862202 2565 generic.go:356] "Generic (PLEG): container finished" podID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerID="7814fdfcbbcfd06cae5dac95ba713f8473a1272d1a2ee39f62abb68b3463044f" exitCode=143 Jun 12 21:57:06.862646 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:06.862282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"caf06199-8fa8-4df6-9bf7-076aa7f25352","Type":"ContainerDied","Data":"7814fdfcbbcfd06cae5dac95ba713f8473a1272d1a2ee39f62abb68b3463044f"} Jun 12 21:57:07.134670 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.134636 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:07.248060 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.248030 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p\") pod \"caf06199-8fa8-4df6-9bf7-076aa7f25352\" (UID: \"caf06199-8fa8-4df6-9bf7-076aa7f25352\") " Jun 12 21:57:07.250368 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.250330 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p" (OuterVolumeSpecName: "kube-api-access-qng5p") pod "caf06199-8fa8-4df6-9bf7-076aa7f25352" (UID: "caf06199-8fa8-4df6-9bf7-076aa7f25352"). InnerVolumeSpecName "kube-api-access-qng5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:57:07.348985 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.348938 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/caf06199-8fa8-4df6-9bf7-076aa7f25352-kube-api-access-qng5p\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 21:57:07.869335 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.869301 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:07.869335 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.869316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"caf06199-8fa8-4df6-9bf7-076aa7f25352","Type":"ContainerDied","Data":"785f00c79ed29fe23222e2d1f4c7021a0cbcaf7a765d45dc3eea5e87f5007ac8"} Jun 12 21:57:07.869937 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.869410 2565 scope.go:117] "RemoveContainer" containerID="7814fdfcbbcfd06cae5dac95ba713f8473a1272d1a2ee39f62abb68b3463044f" Jun 12 21:57:07.890589 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.890555 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:07.894947 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.894921 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:07.922187 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.922152 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:07.922529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.922517 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" Jun 12 21:57:07.922573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.922531 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" Jun 12 21:57:07.922605 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.922592 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" containerName="keycloak" Jun 12 21:57:07.927042 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.927024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:07.929405 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.929385 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 21:57:07.929590 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.929576 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 21:57:07.929717 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.929674 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 21:57:07.929772 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.929707 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 21:57:07.929772 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.929735 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8n7md\"" Jun 12 21:57:07.934430 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:07.934405 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:08.056302 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.056261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4986\" (UniqueName: \"kubernetes.io/projected/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-kube-api-access-c4986\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.056302 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.056303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.064276 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.064247 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf06199-8fa8-4df6-9bf7-076aa7f25352" path="/var/lib/kubelet/pods/caf06199-8fa8-4df6-9bf7-076aa7f25352/volumes" Jun 12 21:57:08.157803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.157702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4986\" (UniqueName: \"kubernetes.io/projected/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-kube-api-access-c4986\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.157803 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.157750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.158512 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.158492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-test-realms\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.165637 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.165607 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4986\" (UniqueName: \"kubernetes.io/projected/f3efdca8-b87f-45d1-8f16-a27eb2eddfe7-kube-api-access-c4986\") pod \"maas-keycloak-0\" (UID: \"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7\") " pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.238501 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.238461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:08.373307 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.373281 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 21:57:08.375020 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:57:08.374990 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3efdca8_b87f_45d1_8f16_a27eb2eddfe7.slice/crio-efcedcb6b753c52d3a24d57915fe2468a1c543d87d3d08cf83823c50b2f8595c WatchSource:0}: Error finding container efcedcb6b753c52d3a24d57915fe2468a1c543d87d3d08cf83823c50b2f8595c: Status 404 returned error can't find the container with id efcedcb6b753c52d3a24d57915fe2468a1c543d87d3d08cf83823c50b2f8595c Jun 12 21:57:08.376288 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.376270 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:57:08.878149 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.878116 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7","Type":"ContainerStarted","Data":"917ecb6499b760d4f912711dec2a386cab92b0df82f1797ea4c4594fba92043b"} Jun 12 21:57:08.878527 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.878166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3efdca8-b87f-45d1-8f16-a27eb2eddfe7","Type":"ContainerStarted","Data":"efcedcb6b753c52d3a24d57915fe2468a1c543d87d3d08cf83823c50b2f8595c"} Jun 12 21:57:08.896551 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:08.896498 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.535234303 podStartE2EDuration="1.89647961s" totalImagesPullingTime="361.245307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:57:08.895185809 +0000 UTC m=+713.338020180" watchObservedRunningTime="2026-06-12 21:57:08.89647961 +0000 UTC m=+713.339313985" Jun 12 21:57:09.239526 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:09.239489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:09.241371 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:09.241332 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:10.239149 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:10.239089 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:11.239792 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:11.239739 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:12.239600 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:12.239544 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:13.239828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:13.239772 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:14.239760 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:14.239717 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:15.239623 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:15.239567 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:16.239023 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:16.238970 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:17.239431 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:17.239382 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:18.239314 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:18.239266 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:18.239592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:18.239555 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:19.239592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:19.239536 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:20.239740 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:20.239659 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:21.239888 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:21.239843 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 12 21:57:22.331926 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:22.331884 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:22.347137 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:22.347067 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f3efdca8-b87f-45d1-8f16-a27eb2eddfe7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 21:57:32.338196 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:32.338150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 21:57:52.999874 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:52.999836 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc"] Jun 12 21:57:53.003629 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.003612 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.007381 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.007358 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 21:57:53.007559 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.007529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9cpwx\"" Jun 12 21:57:53.007681 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.007485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 21:57:53.007794 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.007418 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 21:57:53.011623 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.011282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc"] Jun 12 21:57:53.068448 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.068592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.068592 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.068664 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.068664 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.068774 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.068662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfbt\" (UniqueName: \"kubernetes.io/projected/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kube-api-access-2tfbt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169330 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169330 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169545 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169545 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169664 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169664 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfbt\" (UniqueName: \"kubernetes.io/projected/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kube-api-access-2tfbt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.169820 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.169743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.170218 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.170063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.170335 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.170259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.173195 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.173165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.178004 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.177982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.178584 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.178556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfbt\" (UniqueName: \"kubernetes.io/projected/7ebfd376-9793-4b32-b7de-0bcbb3cc42ae-kube-api-access-2tfbt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc\" (UID: \"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.315937 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.315838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:57:53.452947 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:53.452925 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc"] Jun 12 21:57:53.454665 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:57:53.454623 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebfd376_9793_4b32_b7de_0bcbb3cc42ae.slice/crio-3d3d883b2a02b9a24963813fbeba3107742cf004e5fce3f8b1da428476644a95 WatchSource:0}: Error finding container 3d3d883b2a02b9a24963813fbeba3107742cf004e5fce3f8b1da428476644a95: Status 404 returned error can't find the container with id 3d3d883b2a02b9a24963813fbeba3107742cf004e5fce3f8b1da428476644a95 Jun 12 21:57:54.207271 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:54.207236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" event={"ID":"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae","Type":"ContainerStarted","Data":"3d3d883b2a02b9a24963813fbeba3107742cf004e5fce3f8b1da428476644a95"} Jun 12 21:57:57.229240 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:57:57.229204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" event={"ID":"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae","Type":"ContainerStarted","Data":"3ac1bbb2949121f6f384e4cf1cbed6d9515a2a1f36b19d619993eacb82a9f182"} Jun 12 21:58:30.504431 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.504381 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7"] Jun 12 21:58:30.523905 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.523876 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7"] Jun 12 21:58:30.524066 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.523989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.526483 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.526460 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 21:58:30.606761 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.606952 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.606952 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njchk\" (UniqueName: \"kubernetes.io/projected/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kube-api-access-njchk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.606952 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.606952 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cdb4a1-619c-467e-a34e-2b58d83e7880-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.607110 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.606958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708069 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njchk\" (UniqueName: \"kubernetes.io/projected/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kube-api-access-njchk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cdb4a1-619c-467e-a34e-2b58d83e7880-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708310 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708525 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708578 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.708616 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.708575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.710568 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.710546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1cdb4a1-619c-467e-a34e-2b58d83e7880-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.710760 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.710742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cdb4a1-619c-467e-a34e-2b58d83e7880-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.716882 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.716856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njchk\" (UniqueName: \"kubernetes.io/projected/f1cdb4a1-619c-467e-a34e-2b58d83e7880-kube-api-access-njchk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7\" (UID: \"f1cdb4a1-619c-467e-a34e-2b58d83e7880\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.835184 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.835084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:30.980456 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:30.980424 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7"] Jun 12 21:58:30.981800 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:58:30.981770 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cdb4a1_619c_467e_a34e_2b58d83e7880.slice/crio-c8c5abd4b923b271e5d8e0cb300e789c138345efeb82683d774eb8b2c3a76c95 WatchSource:0}: Error finding container c8c5abd4b923b271e5d8e0cb300e789c138345efeb82683d774eb8b2c3a76c95: Status 404 returned error can't find the container with id c8c5abd4b923b271e5d8e0cb300e789c138345efeb82683d774eb8b2c3a76c95 Jun 12 21:58:31.431569 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:31.431530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" event={"ID":"f1cdb4a1-619c-467e-a34e-2b58d83e7880","Type":"ContainerStarted","Data":"e36c00a2ba831bcb4be6f2893dba0e6a74c66d25650413e3230ed45d7e565d6a"} Jun 12 21:58:31.431780 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:31.431598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" event={"ID":"f1cdb4a1-619c-467e-a34e-2b58d83e7880","Type":"ContainerStarted","Data":"c8c5abd4b923b271e5d8e0cb300e789c138345efeb82683d774eb8b2c3a76c95"} Jun 12 21:58:35.457120 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:35.457084 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1cdb4a1-619c-467e-a34e-2b58d83e7880" containerID="e36c00a2ba831bcb4be6f2893dba0e6a74c66d25650413e3230ed45d7e565d6a" exitCode=0 Jun 12 21:58:35.457610 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:35.457164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" event={"ID":"f1cdb4a1-619c-467e-a34e-2b58d83e7880","Type":"ContainerDied","Data":"e36c00a2ba831bcb4be6f2893dba0e6a74c66d25650413e3230ed45d7e565d6a"} Jun 12 21:58:37.470751 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:37.470715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" event={"ID":"f1cdb4a1-619c-467e-a34e-2b58d83e7880","Type":"ContainerStarted","Data":"6e99ef74615490b7c9818eeb1478f0bdf08e386eb20ef262f4f26a2f316d8d32"} Jun 12 21:58:37.491325 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:37.491266 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" podStartSLOduration=3.04996171 podStartE2EDuration="7.491249346s" totalImagesPullingTime="1.039020293s" totalInitContainerRuntime="3.402267343s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:58:37.488094192 +0000 UTC m=+801.930928567" watchObservedRunningTime="2026-06-12 21:58:37.491249346 +0000 UTC m=+801.934083720" Jun 12 21:58:40.835817 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:40.835774 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:40.836202 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:40.835888 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:40.848839 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:40.848811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:41.504522 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:41.504495 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7" Jun 12 21:58:45.204747 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.204712 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb"] Jun 12 21:58:45.210211 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.210187 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.212678 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.212659 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 21:58:45.225090 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.225063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb"] Jun 12 21:58:45.349756 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349717 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.349953 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34451f1-7743-455a-a6a2-0e8d0d3e291a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.349953 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s996\" (UniqueName: \"kubernetes.io/projected/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kube-api-access-9s996\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.349953 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.350082 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.350082 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.349992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451443 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451622 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34451f1-7743-455a-a6a2-0e8d0d3e291a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451622 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s996\" (UniqueName: \"kubernetes.io/projected/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kube-api-access-9s996\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451622 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451622 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.451872 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.452000 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.451980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.452068 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.452012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.452142 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.452118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.454032 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.454011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34451f1-7743-455a-a6a2-0e8d0d3e291a-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.454213 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.454196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34451f1-7743-455a-a6a2-0e8d0d3e291a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.459865 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.459812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s996\" (UniqueName: \"kubernetes.io/projected/a34451f1-7743-455a-a6a2-0e8d0d3e291a-kube-api-access-9s996\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb\" (UID: \"a34451f1-7743-455a-a6a2-0e8d0d3e291a\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.522910 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.522874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:45.663773 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:45.663741 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb"] Jun 12 21:58:45.665251 ip-10-0-142-94 kubenswrapper[2565]: W0612 21:58:45.665220 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34451f1_7743_455a_a6a2_0e8d0d3e291a.slice/crio-a282fe10367b6f28889933902d8562fc1d713b4721ab7113c015fff253ec214b WatchSource:0}: Error finding container a282fe10367b6f28889933902d8562fc1d713b4721ab7113c015fff253ec214b: Status 404 returned error can't find the container with id a282fe10367b6f28889933902d8562fc1d713b4721ab7113c015fff253ec214b Jun 12 21:58:46.530122 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:46.530074 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" event={"ID":"a34451f1-7743-455a-a6a2-0e8d0d3e291a","Type":"ContainerStarted","Data":"48710c319152eab8a6f07c9779ebf0fe614bf3f771f2b64e33742633805ef4ad"} Jun 12 21:58:46.530580 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:46.530136 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" event={"ID":"a34451f1-7743-455a-a6a2-0e8d0d3e291a","Type":"ContainerStarted","Data":"a282fe10367b6f28889933902d8562fc1d713b4721ab7113c015fff253ec214b"} Jun 12 21:58:47.538182 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:47.538144 2565 generic.go:356] "Generic (PLEG): container finished" podID="a34451f1-7743-455a-a6a2-0e8d0d3e291a" containerID="48710c319152eab8a6f07c9779ebf0fe614bf3f771f2b64e33742633805ef4ad" exitCode=0 Jun 12 21:58:47.538625 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:47.538228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" event={"ID":"a34451f1-7743-455a-a6a2-0e8d0d3e291a","Type":"ContainerDied","Data":"48710c319152eab8a6f07c9779ebf0fe614bf3f771f2b64e33742633805ef4ad"} Jun 12 21:58:48.546427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:48.546389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" event={"ID":"a34451f1-7743-455a-a6a2-0e8d0d3e291a","Type":"ContainerStarted","Data":"17d5dbaf5664f1ec4a9f248ff7eb5b9c8fb81deb402380ea088d6f0a29bde070"} Jun 12 21:58:48.566529 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:48.566470 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" podStartSLOduration=2.120354341 podStartE2EDuration="3.566452694s" totalImagesPullingTime="193.592876ms" totalInitContainerRuntime="1.252505477s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:58:48.56395517 +0000 UTC m=+813.006789545" watchObservedRunningTime="2026-06-12 21:58:48.566452694 +0000 UTC m=+813.009287068" Jun 12 21:58:55.523421 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:55.523374 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:55.523950 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:55.523450 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:55.538286 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:55.538256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:58:55.607362 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:58:55.607334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb" Jun 12 21:59:19.740427 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:19.740394 2565 generic.go:356] "Generic (PLEG): container finished" podID="7ebfd376-9793-4b32-b7de-0bcbb3cc42ae" containerID="3ac1bbb2949121f6f384e4cf1cbed6d9515a2a1f36b19d619993eacb82a9f182" exitCode=0 Jun 12 21:59:19.740895 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:19.740418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" event={"ID":"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae","Type":"ContainerDied","Data":"3ac1bbb2949121f6f384e4cf1cbed6d9515a2a1f36b19d619993eacb82a9f182"} Jun 12 21:59:20.748386 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:20.748349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" event={"ID":"7ebfd376-9793-4b32-b7de-0bcbb3cc42ae","Type":"ContainerStarted","Data":"fa884af2e2f4241f635d883d553f5e0613a9cfd9a7812e0cc576b0702e114362"} Jun 12 21:59:20.768809 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:20.768765 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" podStartSLOduration=2.434559952 podStartE2EDuration="1m28.768750814s" totalImagesPullingTime="3.418794097s" totalInitContainerRuntime="1m22.915396765s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:57:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:59:20.768224763 +0000 UTC m=+845.211059136" watchObservedRunningTime="2026-06-12 21:59:20.768750814 +0000 UTC m=+845.211585187" Jun 12 21:59:23.316169 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:23.316129 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:59:23.316573 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:23.316202 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:59:23.328891 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:23.328865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 21:59:23.776828 ip-10-0-142-94 kubenswrapper[2565]: I0612 21:59:23.776798 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc" Jun 12 22:00:00.152805 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.152767 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688360-2gkmm"] Jun 12 22:00:00.156515 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.156499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:00.160066 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.160042 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s7h9r\"" Jun 12 22:00:00.165568 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.165546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688360-2gkmm"] Jun 12 22:00:00.206361 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.206329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7mh\" (UniqueName: \"kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh\") pod \"maas-api-key-cleanup-29688360-2gkmm\" (UID: \"5b134fd0-56dc-4237-bdfa-c4b12dd875aa\") " pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:00.307674 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.307637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7mh\" (UniqueName: \"kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh\") pod \"maas-api-key-cleanup-29688360-2gkmm\" (UID: \"5b134fd0-56dc-4237-bdfa-c4b12dd875aa\") " pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:00.317488 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.317455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7mh\" (UniqueName: \"kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh\") pod \"maas-api-key-cleanup-29688360-2gkmm\" (UID: \"5b134fd0-56dc-4237-bdfa-c4b12dd875aa\") " pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:00.490000 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.489975 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:00.631743 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.631707 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688360-2gkmm"] Jun 12 22:00:00.632613 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:00:00.632586 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b134fd0_56dc_4237_bdfa_c4b12dd875aa.slice/crio-2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1 WatchSource:0}: Error finding container 2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1: Status 404 returned error can't find the container with id 2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1 Jun 12 22:00:00.998465 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:00.998424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" event={"ID":"5b134fd0-56dc-4237-bdfa-c4b12dd875aa","Type":"ContainerStarted","Data":"2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1"} Jun 12 22:00:11.059737 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:11.059673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" event={"ID":"5b134fd0-56dc-4237-bdfa-c4b12dd875aa","Type":"ContainerStarted","Data":"f149c7025f4a824f97facc828775505c3cdf48f5ac8f1cd040b6340585c56a49"} Jun 12 22:00:11.075933 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:11.075885 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" podStartSLOduration=1.150218457 podStartE2EDuration="11.075868658s" totalImagesPullingTime="9.925650201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:00:11.074054829 +0000 UTC m=+895.516889206" watchObservedRunningTime="2026-06-12 22:00:11.075868658 +0000 UTC m=+895.518703031" Jun 12 22:00:12.068345 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:12.068311 2565 generic.go:356] "Generic (PLEG): container finished" podID="5b134fd0-56dc-4237-bdfa-c4b12dd875aa" containerID="f149c7025f4a824f97facc828775505c3cdf48f5ac8f1cd040b6340585c56a49" exitCode=0 Jun 12 22:00:12.068769 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:12.068400 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" event={"ID":"5b134fd0-56dc-4237-bdfa-c4b12dd875aa","Type":"ContainerDied","Data":"f149c7025f4a824f97facc828775505c3cdf48f5ac8f1cd040b6340585c56a49"} Jun 12 22:00:13.216286 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:13.216254 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:13.329533 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:13.329440 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7mh\" (UniqueName: \"kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh\") pod \"5b134fd0-56dc-4237-bdfa-c4b12dd875aa\" (UID: \"5b134fd0-56dc-4237-bdfa-c4b12dd875aa\") " Jun 12 22:00:13.331680 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:13.331650 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh" (OuterVolumeSpecName: "kube-api-access-mv7mh") pod "5b134fd0-56dc-4237-bdfa-c4b12dd875aa" (UID: "5b134fd0-56dc-4237-bdfa-c4b12dd875aa"). InnerVolumeSpecName "kube-api-access-mv7mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:00:13.430973 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:13.430929 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7mh\" (UniqueName: \"kubernetes.io/projected/5b134fd0-56dc-4237-bdfa-c4b12dd875aa-kube-api-access-mv7mh\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:00:14.081560 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:14.081533 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" Jun 12 22:00:14.081725 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:14.081573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688360-2gkmm" event={"ID":"5b134fd0-56dc-4237-bdfa-c4b12dd875aa","Type":"ContainerDied","Data":"2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1"} Jun 12 22:00:14.081725 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:14.081642 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2079aa88f7ae872da1c505f501e45ac39dfa02d2211d696120e4b6b259f184d1" Jun 12 22:00:16.086475 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:16.086444 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:00:16.086924 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:00:16.086489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:01:44.713917 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.713829 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:01:44.714366 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.714222 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b134fd0-56dc-4237-bdfa-c4b12dd875aa" containerName="cleanup" Jun 12 22:01:44.714366 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.714233 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b134fd0-56dc-4237-bdfa-c4b12dd875aa" containerName="cleanup" Jun 12 22:01:44.714366 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.714313 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b134fd0-56dc-4237-bdfa-c4b12dd875aa" containerName="cleanup" Jun 12 22:01:44.717126 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.717105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.728777 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.728747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:01:44.745720 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.745664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.745922 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.745777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khfmd\" (UniqueName: \"kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.846944 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.846910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.847141 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.846978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khfmd\" (UniqueName: \"kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.849514 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.849486 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:44.855870 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:44.855845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khfmd\" (UniqueName: \"kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd\") pod \"maas-controller-774bccd4d7-lmvkt\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:45.028961 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:45.028919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:45.175159 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:45.175131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:01:45.176279 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:01:45.176240 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45e8b8e_ff71_417a_9308_a9044dfe8c8e.slice/crio-e7a24059e7dcfe4fff716a0d4fb5334a72120b9464034035bb1556333610afb2 WatchSource:0}: Error finding container e7a24059e7dcfe4fff716a0d4fb5334a72120b9464034035bb1556333610afb2: Status 404 returned error can't find the container with id e7a24059e7dcfe4fff716a0d4fb5334a72120b9464034035bb1556333610afb2 Jun 12 22:01:45.628607 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:45.628570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" event={"ID":"c45e8b8e-ff71-417a-9308-a9044dfe8c8e","Type":"ContainerStarted","Data":"e7a24059e7dcfe4fff716a0d4fb5334a72120b9464034035bb1556333610afb2"} Jun 12 22:01:45.649272 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:45.649250 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 22:01:46.635987 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:46.635945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" event={"ID":"c45e8b8e-ff71-417a-9308-a9044dfe8c8e","Type":"ContainerStarted","Data":"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82"} Jun 12 22:01:46.636388 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:46.636014 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:46.656045 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:46.655994 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" podStartSLOduration=2.187354354 podStartE2EDuration="2.65598036s" totalImagesPullingTime="468.626006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:01:46.653145471 +0000 UTC m=+991.095979845" watchObservedRunningTime="2026-06-12 22:01:46.65598036 +0000 UTC m=+991.098814737" Jun 12 22:01:57.647885 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:57.647848 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:01:57.702047 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:57.702013 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 22:01:57.702243 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:57.702218 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bd5757487-fb6ml" podUID="c56a758f-fd04-416c-b9b4-141fc49646f6" containerName="manager" containerID="cri-o://82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd" gracePeriod=30 Jun 12 22:01:57.959783 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:57.959757 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 22:01:58.069820 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.069791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert\") pod \"c56a758f-fd04-416c-b9b4-141fc49646f6\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " Jun 12 22:01:58.070008 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.069871 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvwcq\" (UniqueName: \"kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq\") pod \"c56a758f-fd04-416c-b9b4-141fc49646f6\" (UID: \"c56a758f-fd04-416c-b9b4-141fc49646f6\") " Jun 12 22:01:58.072123 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.072088 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq" (OuterVolumeSpecName: "kube-api-access-pvwcq") pod "c56a758f-fd04-416c-b9b4-141fc49646f6" (UID: "c56a758f-fd04-416c-b9b4-141fc49646f6"). InnerVolumeSpecName "kube-api-access-pvwcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:01:58.072123 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.072110 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c56a758f-fd04-416c-b9b4-141fc49646f6" (UID: "c56a758f-fd04-416c-b9b4-141fc49646f6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:01:58.170881 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.170835 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c56a758f-fd04-416c-b9b4-141fc49646f6-webhook-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:01:58.170881 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.170871 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvwcq\" (UniqueName: \"kubernetes.io/projected/c56a758f-fd04-416c-b9b4-141fc49646f6-kube-api-access-pvwcq\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:01:58.711179 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.711144 2565 generic.go:356] "Generic (PLEG): container finished" podID="c56a758f-fd04-416c-b9b4-141fc49646f6" containerID="82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd" exitCode=0 Jun 12 22:01:58.711588 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.711191 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd5757487-fb6ml" Jun 12 22:01:58.711588 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.711237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd5757487-fb6ml" event={"ID":"c56a758f-fd04-416c-b9b4-141fc49646f6","Type":"ContainerDied","Data":"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd"} Jun 12 22:01:58.711588 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.711291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd5757487-fb6ml" event={"ID":"c56a758f-fd04-416c-b9b4-141fc49646f6","Type":"ContainerDied","Data":"212426fec351a1288666ef085ff84bda0e1e1055e5a28c5f966709c4c5a4ba6e"} Jun 12 22:01:58.711588 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.711313 2565 scope.go:117] "RemoveContainer" containerID="82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd" Jun 12 22:01:58.721373 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.721353 2565 scope.go:117] "RemoveContainer" containerID="82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd" Jun 12 22:01:58.721616 ip-10-0-142-94 kubenswrapper[2565]: E0612 22:01:58.721597 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd\": container with ID starting with 82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd not found: ID does not exist" containerID="82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd" Jun 12 22:01:58.721668 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.721626 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd"} err="failed to get container status \"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd\": rpc error: code = NotFound desc = could not find container \"82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd\": container with ID starting with 82031fbc74ee65eb8f0aad2755d6964c611fd4c718185aae40e541030496a4dd not found: ID does not exist" Jun 12 22:01:58.733738 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.733709 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 22:01:58.737639 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:01:58.737568 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bd5757487-fb6ml"] Jun 12 22:02:00.065421 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:02:00.065390 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56a758f-fd04-416c-b9b4-141fc49646f6" path="/var/lib/kubelet/pods/c56a758f-fd04-416c-b9b4-141fc49646f6/volumes" Jun 12 22:03:39.511669 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.511626 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:03:39.512209 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.511848 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" podUID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" containerName="manager" containerID="cri-o://fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82" gracePeriod=30 Jun 12 22:03:39.770222 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.770151 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:03:39.897098 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.897045 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khfmd\" (UniqueName: \"kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd\") pod \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " Jun 12 22:03:39.897297 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.897137 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert\") pod \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\" (UID: \"c45e8b8e-ff71-417a-9308-a9044dfe8c8e\") " Jun 12 22:03:39.899311 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.899279 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd" (OuterVolumeSpecName: "kube-api-access-khfmd") pod "c45e8b8e-ff71-417a-9308-a9044dfe8c8e" (UID: "c45e8b8e-ff71-417a-9308-a9044dfe8c8e"). InnerVolumeSpecName "kube-api-access-khfmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:03:39.899311 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.899303 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c45e8b8e-ff71-417a-9308-a9044dfe8c8e" (UID: "c45e8b8e-ff71-417a-9308-a9044dfe8c8e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:03:39.998462 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.998423 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khfmd\" (UniqueName: \"kubernetes.io/projected/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-kube-api-access-khfmd\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:03:39.998462 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:39.998455 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45e8b8e-ff71-417a-9308-a9044dfe8c8e-webhook-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:03:40.336348 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.336254 2565 generic.go:356] "Generic (PLEG): container finished" podID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" containerID="fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82" exitCode=0 Jun 12 22:03:40.336348 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.336320 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" Jun 12 22:03:40.336582 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.336346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" event={"ID":"c45e8b8e-ff71-417a-9308-a9044dfe8c8e","Type":"ContainerDied","Data":"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82"} Jun 12 22:03:40.336582 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.336420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-lmvkt" event={"ID":"c45e8b8e-ff71-417a-9308-a9044dfe8c8e","Type":"ContainerDied","Data":"e7a24059e7dcfe4fff716a0d4fb5334a72120b9464034035bb1556333610afb2"} Jun 12 22:03:40.336582 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.336449 2565 scope.go:117] "RemoveContainer" containerID="fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82" Jun 12 22:03:40.345632 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.345615 2565 scope.go:117] "RemoveContainer" containerID="fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82" Jun 12 22:03:40.345926 ip-10-0-142-94 kubenswrapper[2565]: E0612 22:03:40.345890 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82\": container with ID starting with fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82 not found: ID does not exist" containerID="fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82" Jun 12 22:03:40.346049 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.345926 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82"} err="failed to get container status \"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82\": rpc error: code = NotFound desc = could not find container \"fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82\": container with ID starting with fb32fef63b4b0efdc8e8e7c730f01a64091bbcb5bb031fc590553a7589494d82 not found: ID does not exist" Jun 12 22:03:40.359406 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.359371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:03:40.363932 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:40.363905 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-lmvkt"] Jun 12 22:03:41.182831 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.182798 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774bccd4d7-4gd8c"] Jun 12 22:03:41.183232 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183171 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" containerName="manager" Jun 12 22:03:41.183232 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183182 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" containerName="manager" Jun 12 22:03:41.183232 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183207 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56a758f-fd04-416c-b9b4-141fc49646f6" containerName="manager" Jun 12 22:03:41.183232 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183212 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56a758f-fd04-416c-b9b4-141fc49646f6" containerName="manager" Jun 12 22:03:41.183365 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183267 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" containerName="manager" Jun 12 22:03:41.183365 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.183279 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56a758f-fd04-416c-b9b4-141fc49646f6" containerName="manager" Jun 12 22:03:41.187855 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.187834 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.190397 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.190377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 22:03:41.191100 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.191084 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-drtz4\"" Jun 12 22:03:41.191100 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.191096 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 22:03:41.195939 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.195919 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-4gd8c"] Jun 12 22:03:41.309085 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.309058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee4a887a-74ba-470a-ad70-69e2316ebd8a-webhook-cert\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.309258 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.309116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82p4\" (UniqueName: \"kubernetes.io/projected/ee4a887a-74ba-470a-ad70-69e2316ebd8a-kube-api-access-r82p4\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.410229 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.410193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82p4\" (UniqueName: \"kubernetes.io/projected/ee4a887a-74ba-470a-ad70-69e2316ebd8a-kube-api-access-r82p4\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.410402 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.410271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee4a887a-74ba-470a-ad70-69e2316ebd8a-webhook-cert\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.412911 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.412877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee4a887a-74ba-470a-ad70-69e2316ebd8a-webhook-cert\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.420372 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.420345 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82p4\" (UniqueName: \"kubernetes.io/projected/ee4a887a-74ba-470a-ad70-69e2316ebd8a-kube-api-access-r82p4\") pod \"maas-controller-774bccd4d7-4gd8c\" (UID: \"ee4a887a-74ba-470a-ad70-69e2316ebd8a\") " pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.500296 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.500267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:41.641056 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.641031 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774bccd4d7-4gd8c"] Jun 12 22:03:41.642435 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:03:41.642408 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4a887a_74ba_470a_ad70_69e2316ebd8a.slice/crio-d3f6989bdfd7373828f9fbbb24d1f10b14d72491e1a6ca771ad3fc19679ed42c WatchSource:0}: Error finding container d3f6989bdfd7373828f9fbbb24d1f10b14d72491e1a6ca771ad3fc19679ed42c: Status 404 returned error can't find the container with id d3f6989bdfd7373828f9fbbb24d1f10b14d72491e1a6ca771ad3fc19679ed42c Jun 12 22:03:41.643703 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:41.643662 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:03:42.065628 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:42.065598 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45e8b8e-ff71-417a-9308-a9044dfe8c8e" path="/var/lib/kubelet/pods/c45e8b8e-ff71-417a-9308-a9044dfe8c8e/volumes" Jun 12 22:03:42.350740 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:42.350633 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" event={"ID":"ee4a887a-74ba-470a-ad70-69e2316ebd8a","Type":"ContainerStarted","Data":"a99ec4ad9e5234a0cc78994efcf19906eef2053cd1a5ccdad2eb1ac0a656efde"} Jun 12 22:03:42.350740 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:42.350710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" event={"ID":"ee4a887a-74ba-470a-ad70-69e2316ebd8a","Type":"ContainerStarted","Data":"d3f6989bdfd7373828f9fbbb24d1f10b14d72491e1a6ca771ad3fc19679ed42c"} Jun 12 22:03:42.350740 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:42.350735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:03:42.369517 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:42.369467 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" podStartSLOduration=1.012635481 podStartE2EDuration="1.369452612s" totalImagesPullingTime="356.817131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:03:42.367635924 +0000 UTC m=+1106.810470316" watchObservedRunningTime="2026-06-12 22:03:42.369452612 +0000 UTC m=+1106.812287012" Jun 12 22:03:53.362972 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:03:53.362943 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774bccd4d7-4gd8c" Jun 12 22:05:16.125240 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:05:16.125210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:05:16.127275 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:05:16.127251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:10:16.166236 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:10:16.166201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:10:16.169405 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:10:16.169383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:11:39.341804 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.341762 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 22:11:39.342662 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.341957 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" podUID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" containerName="manager" containerID="cri-o://e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed" gracePeriod=10 Jun 12 22:11:39.602546 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.602479 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 22:11:39.741460 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.741421 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb7nr\" (UniqueName: \"kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr\") pod \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " Jun 12 22:11:39.741460 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.741464 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume\") pod \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\" (UID: \"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408\") " Jun 12 22:11:39.741847 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.741822 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" (UID: "ebaf22ca-9fbb-4280-ab64-c0f2c92e2408"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:11:39.743673 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.743647 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr" (OuterVolumeSpecName: "kube-api-access-sb7nr") pod "ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" (UID: "ebaf22ca-9fbb-4280-ab64-c0f2c92e2408"). InnerVolumeSpecName "kube-api-access-sb7nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:11:39.842181 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.842123 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb7nr\" (UniqueName: \"kubernetes.io/projected/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-kube-api-access-sb7nr\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:11:39.842181 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:39.842175 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408-extensions-socket-volume\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:11:40.245663 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.245630 2565 generic.go:356] "Generic (PLEG): container finished" podID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" containerID="e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed" exitCode=0 Jun 12 22:11:40.245865 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.245671 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" Jun 12 22:11:40.245865 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.245719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" event={"ID":"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408","Type":"ContainerDied","Data":"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed"} Jun 12 22:11:40.245865 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.245772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75" event={"ID":"ebaf22ca-9fbb-4280-ab64-c0f2c92e2408","Type":"ContainerDied","Data":"2e8960caaea4fc42c19ebde8dc52eed4700f38ca924eee7907e0ba845b1bc99e"} Jun 12 22:11:40.245865 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.245795 2565 scope.go:117] "RemoveContainer" containerID="e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed" Jun 12 22:11:40.255650 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.255633 2565 scope.go:117] "RemoveContainer" containerID="e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed" Jun 12 22:11:40.255923 ip-10-0-142-94 kubenswrapper[2565]: E0612 22:11:40.255901 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed\": container with ID starting with e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed not found: ID does not exist" containerID="e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed" Jun 12 22:11:40.256000 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.255932 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed"} err="failed to get container status \"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed\": rpc error: code = NotFound desc = could not find container \"e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed\": container with ID starting with e55fe34b490b4afce9180aa6e318e32c5d329a35b514ba9b6ef579b25c4439ed not found: ID does not exist" Jun 12 22:11:40.268238 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.268204 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 22:11:40.276741 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:40.276716 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p9l75"] Jun 12 22:11:42.065289 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:11:42.065253 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" path="/var/lib/kubelet/pods/ebaf22ca-9fbb-4280-ab64-c0f2c92e2408/volumes" Jun 12 22:12:40.486002 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.485963 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8"] Jun 12 22:12:40.486449 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.486349 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" containerName="manager" Jun 12 22:12:40.486449 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.486360 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" containerName="manager" Jun 12 22:12:40.486449 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.486434 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebaf22ca-9fbb-4280-ab64-c0f2c92e2408" containerName="manager" Jun 12 22:12:40.490815 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.490797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.493663 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.493645 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2ttt\"" Jun 12 22:12:40.505648 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.505624 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8"] Jun 12 22:12:40.569750 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.569711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/02438fa0-c5d9-4e5e-a5e1-92ca42419562-kube-api-access-vjwvn\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.569927 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.569809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02438fa0-c5d9-4e5e-a5e1-92ca42419562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.670223 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.670189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02438fa0-c5d9-4e5e-a5e1-92ca42419562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.670402 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.670267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/02438fa0-c5d9-4e5e-a5e1-92ca42419562-kube-api-access-vjwvn\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.670603 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.670582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02438fa0-c5d9-4e5e-a5e1-92ca42419562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.680456 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.680431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/02438fa0-c5d9-4e5e-a5e1-92ca42419562-kube-api-access-vjwvn\") pod \"kuadrant-operator-controller-manager-86878c769f-r6qw8\" (UID: \"02438fa0-c5d9-4e5e-a5e1-92ca42419562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.800648 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.800617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:40.954288 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:40.954255 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8"] Jun 12 22:12:40.955661 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:12:40.955372 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02438fa0_c5d9_4e5e_a5e1_92ca42419562.slice/crio-4ca5d34505eb4ae125d56ad505c7df956ab05f2a550b02175974dab4f348f1e6 WatchSource:0}: Error finding container 4ca5d34505eb4ae125d56ad505c7df956ab05f2a550b02175974dab4f348f1e6: Status 404 returned error can't find the container with id 4ca5d34505eb4ae125d56ad505c7df956ab05f2a550b02175974dab4f348f1e6 Jun 12 22:12:41.614062 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:41.614027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" event={"ID":"02438fa0-c5d9-4e5e-a5e1-92ca42419562","Type":"ContainerStarted","Data":"b8699aa26c783a78697c30e6abd994d29158ef0bd8a5c62c73d35791ff62780e"} Jun 12 22:12:41.614540 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:41.614082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" event={"ID":"02438fa0-c5d9-4e5e-a5e1-92ca42419562","Type":"ContainerStarted","Data":"4ca5d34505eb4ae125d56ad505c7df956ab05f2a550b02175974dab4f348f1e6"} Jun 12 22:12:41.614540 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:41.614177 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:12:41.635857 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:41.635799 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" podStartSLOduration=1.635777142 podStartE2EDuration="1.635777142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:12:41.632769729 +0000 UTC m=+1646.075604106" watchObservedRunningTime="2026-06-12 22:12:41.635777142 +0000 UTC m=+1646.078611517" Jun 12 22:12:52.622514 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:12:52.622484 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6qw8" Jun 12 22:15:16.206985 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:15:16.206874 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:15:16.211655 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:15:16.211632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:20:16.249326 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:20:16.249300 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:20:16.253837 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:20:16.253816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:22:00.815066 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.815027 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:00.819531 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.819500 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.821874 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.821852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a4a825a9-openshift-default-dockercfg-wxrp7\"" Jun 12 22:22:00.843060 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.843025 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:00.862323 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862323 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862530 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862530 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862530 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862530 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6jk\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862530 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862757 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.862757 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.862602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.964086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.964034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.964346 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.964331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.964755 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.964677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965003 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.964965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965133 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965133 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965257 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965257 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965257 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965421 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6jk\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.965946 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.965921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.966108 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.966023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.966108 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.966034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.966799 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.966773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.968901 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.968851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.969293 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.969244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.977582 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.977541 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6jk\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:00.978268 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:00.978241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token\") pod \"e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:01.131234 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:01.131138 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:01.296345 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:01.296313 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:01.297865 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:22:01.297834 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29472326_5f85_47d3_a042_8e163166ac4d.slice/crio-43c98b3bff227b2ba24ba19a0c1c09e11c5c52d16206f4db61aa69bbfd7543f7 WatchSource:0}: Error finding container 43c98b3bff227b2ba24ba19a0c1c09e11c5c52d16206f4db61aa69bbfd7543f7: Status 404 returned error can't find the container with id 43c98b3bff227b2ba24ba19a0c1c09e11c5c52d16206f4db61aa69bbfd7543f7 Jun 12 22:22:01.299960 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:01.299942 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:22:02.030354 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:02.030317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" event={"ID":"29472326-5f85-47d3-a042-8e163166ac4d","Type":"ContainerStarted","Data":"43c98b3bff227b2ba24ba19a0c1c09e11c5c52d16206f4db61aa69bbfd7543f7"} Jun 12 22:22:04.079783 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:04.079745 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:22:04.080100 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:04.079823 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:22:04.080100 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:04.079866 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:22:05.050990 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:05.050944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" event={"ID":"29472326-5f85-47d3-a042-8e163166ac4d","Type":"ContainerStarted","Data":"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8"} Jun 12 22:22:05.109389 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:05.109337 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" podStartSLOduration=2.3300685469999998 podStartE2EDuration="5.109319425s" totalImagesPullingTime="2.779250878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:05.102505614 +0000 UTC m=+2209.545339982" watchObservedRunningTime="2026-06-12 22:22:05.109319425 +0000 UTC m=+2209.552153798" Jun 12 22:22:05.131648 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:05.131610 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:05.136901 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:05.136867 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:06.065955 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:06.065926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:06.066138 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:06.066002 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:07.260805 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:07.260772 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:08.071733 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:08.071683 2565 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" secret="" err="secret \"e2e-ait-a4a825a9-openshift-default-dockercfg-wxrp7\" not found" Jun 12 22:22:09.077658 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:09.077606 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" podUID="29472326-5f85-47d3-a042-8e163166ac4d" containerName="istio-proxy" containerID="cri-o://63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8" gracePeriod=30 Jun 12 22:22:14.360105 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.360071 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:14.493267 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493267 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493271 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g6jk\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493305 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493327 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493350 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493421 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493438 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493459 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493547 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493501 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data\") pod \"29472326-5f85-47d3-a042-8e163166ac4d\" (UID: \"29472326-5f85-47d3-a042-8e163166ac4d\") " Jun 12 22:22:14.493941 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:22:14.493941 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493764 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:22:14.493941 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493820 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-socket\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.493941 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493907 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:22:14.494128 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493950 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:22:14.494128 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.493947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:14.495968 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.495935 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:22:14.495968 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.495954 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 22:22:14.496137 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.496029 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk" (OuterVolumeSpecName: "kube-api-access-5g6jk") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "kube-api-access-5g6jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:22:14.496137 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.496067 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29472326-5f85-47d3-a042-8e163166ac4d" (UID: "29472326-5f85-47d3-a042-8e163166ac4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595240 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-envoy\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595277 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-istio-token\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595287 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-workload-certs\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595296 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-istio-data\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595304 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g6jk\" (UniqueName: \"kubernetes.io/projected/29472326-5f85-47d3-a042-8e163166ac4d-kube-api-access-5g6jk\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595314 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29472326-5f85-47d3-a042-8e163166ac4d-credential-socket\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595323 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29472326-5f85-47d3-a042-8e163166ac4d-istiod-ca-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:14.595340 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:14.595332 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29472326-5f85-47d3-a042-8e163166ac4d-istio-podinfo\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:22:15.114151 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.114113 2565 generic.go:356] "Generic (PLEG): container finished" podID="29472326-5f85-47d3-a042-8e163166ac4d" containerID="63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8" exitCode=0 Jun 12 22:22:15.114334 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.114161 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" Jun 12 22:22:15.114334 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.114184 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" event={"ID":"29472326-5f85-47d3-a042-8e163166ac4d","Type":"ContainerDied","Data":"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8"} Jun 12 22:22:15.114334 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.114243 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8" event={"ID":"29472326-5f85-47d3-a042-8e163166ac4d","Type":"ContainerDied","Data":"43c98b3bff227b2ba24ba19a0c1c09e11c5c52d16206f4db61aa69bbfd7543f7"} Jun 12 22:22:15.114334 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.114265 2565 scope.go:117] "RemoveContainer" containerID="63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8" Jun 12 22:22:15.125299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.125277 2565 scope.go:117] "RemoveContainer" containerID="63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8" Jun 12 22:22:15.125582 ip-10-0-142-94 kubenswrapper[2565]: E0612 22:22:15.125556 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8\": container with ID starting with 63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8 not found: ID does not exist" containerID="63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8" Jun 12 22:22:15.125661 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.125595 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8"} err="failed to get container status \"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8\": rpc error: code = NotFound desc = could not find container \"63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8\": container with ID starting with 63473e4516e50797a22c58bc59f1823a5561bcb410eabeb498bdfbd5f1499dd8 not found: ID does not exist" Jun 12 22:22:15.137730 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.137673 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:15.140507 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:15.140480 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a4a825a9-openshift-default-698bcdbd44-j7cn8"] Jun 12 22:22:16.069160 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:22:16.069116 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29472326-5f85-47d3-a042-8e163166ac4d" path="/var/lib/kubelet/pods/29472326-5f85-47d3-a042-8e163166ac4d/volumes" Jun 12 22:24:53.696212 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.696160 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:24:53.696836 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.696800 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29472326-5f85-47d3-a042-8e163166ac4d" containerName="istio-proxy" Jun 12 22:24:53.696836 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.696818 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29472326-5f85-47d3-a042-8e163166ac4d" containerName="istio-proxy" Jun 12 22:24:53.696975 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.696911 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29472326-5f85-47d3-a042-8e163166ac4d" containerName="istio-proxy" Jun 12 22:24:53.700911 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.700884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.703318 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.703297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fbdd64c0-openshift-default-dockercfg-s7dwb\"" Jun 12 22:24:53.713240 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.712129 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:24:53.835665 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.835888 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.835888 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.835888 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.836062 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.836062 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.835969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.836062 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.836005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vrp\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.836218 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.836066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.836218 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.836111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936619 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vrp\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936619 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.936918 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937167 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.936930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937167 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.937106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937267 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.937165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937267 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.937233 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937375 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.937303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.937853 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.937827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.939319 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.939291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.939612 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.939592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.944294 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.944268 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:53.944735 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:53.944713 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vrp\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp\") pod \"e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:54.015748 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:54.015713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:54.169922 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:54.169886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:24:54.171042 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:24:54.171012 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcccef9_d552_4d2d_b837_586337c85c34.slice/crio-df2fcbe6d824050d1759db32cda1b68afc10f21a45d63c00f343feb6c80cf410 WatchSource:0}: Error finding container df2fcbe6d824050d1759db32cda1b68afc10f21a45d63c00f343feb6c80cf410: Status 404 returned error can't find the container with id df2fcbe6d824050d1759db32cda1b68afc10f21a45d63c00f343feb6c80cf410 Jun 12 22:24:54.173244 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:54.173207 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:24:54.173358 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:54.173281 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:24:54.173358 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:54.173315 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:24:55.065054 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:55.065021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" event={"ID":"9fcccef9-d552-4d2d-b837-586337c85c34","Type":"ContainerStarted","Data":"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e"} Jun 12 22:24:55.065436 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:55.065068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" event={"ID":"9fcccef9-d552-4d2d-b837-586337c85c34","Type":"ContainerStarted","Data":"df2fcbe6d824050d1759db32cda1b68afc10f21a45d63c00f343feb6c80cf410"} Jun 12 22:24:55.083783 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:55.083731 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" podStartSLOduration=2.083712529 podStartE2EDuration="2.083712529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:55.08293886 +0000 UTC m=+2379.525773247" watchObservedRunningTime="2026-06-12 22:24:55.083712529 +0000 UTC m=+2379.526546909" Jun 12 22:24:56.016872 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:56.016827 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:56.022164 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:56.022138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:56.071068 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:56.071034 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:24:56.072135 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:24:56.072115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:25:16.290023 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:25:16.289915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:25:16.304867 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:25:16.296383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:27:09.658718 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:09.658605 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:27:09.659286 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:09.658953 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" containerName="istio-proxy" containerID="cri-o://704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e" gracePeriod=30 Jun 12 22:27:11.073261 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:11.073221 2565 patch_prober.go:28] interesting pod/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 12 22:27:11.073643 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:11.073283 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 22:27:14.916993 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.916916 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:27:14.937889 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.937827 2565 generic.go:356] "Generic (PLEG): container finished" podID="9fcccef9-d552-4d2d-b837-586337c85c34" containerID="704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e" exitCode=0 Jun 12 22:27:14.938097 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.937903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" event={"ID":"9fcccef9-d552-4d2d-b837-586337c85c34","Type":"ContainerDied","Data":"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e"} Jun 12 22:27:14.938097 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.937988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" event={"ID":"9fcccef9-d552-4d2d-b837-586337c85c34","Type":"ContainerDied","Data":"df2fcbe6d824050d1759db32cda1b68afc10f21a45d63c00f343feb6c80cf410"} Jun 12 22:27:14.938097 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.938020 2565 scope.go:117] "RemoveContainer" containerID="704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e" Jun 12 22:27:14.938097 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.938052 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn" Jun 12 22:27:14.951889 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.951860 2565 scope.go:117] "RemoveContainer" containerID="704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e" Jun 12 22:27:14.952290 ip-10-0-142-94 kubenswrapper[2565]: E0612 22:27:14.952268 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e\": container with ID starting with 704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e not found: ID does not exist" containerID="704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e" Jun 12 22:27:14.952366 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:14.952301 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e"} err="failed to get container status \"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e\": rpc error: code = NotFound desc = could not find container \"704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e\": container with ID starting with 704f8cc0d24bb224e8243852544cab9ab0cf4741cac25ec03608d87457cf3b6e not found: ID does not exist" Jun 12 22:27:15.036836 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.036782 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037048 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.036852 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037048 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.036900 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037048 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.036934 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037048 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.036959 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2vrp\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037048 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037029 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037310 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037053 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037310 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037095 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037310 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037119 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token\") pod \"9fcccef9-d552-4d2d-b837-586337c85c34\" (UID: \"9fcccef9-d552-4d2d-b837-586337c85c34\") " Jun 12 22:27:15.037310 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037225 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:15.037310 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037249 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:15.037571 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037421 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:15.037829 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037576 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-certs\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.037829 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037714 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:27:15.037829 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037770 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-credential-socket\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.037829 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037786 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-workload-socket\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.038171 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.037978 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:15.039420 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.039393 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:15.039995 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.039973 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 22:27:15.039995 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.039981 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:27:15.040114 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.039985 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp" (OuterVolumeSpecName: "kube-api-access-q2vrp") pod "9fcccef9-d552-4d2d-b837-586337c85c34" (UID: "9fcccef9-d552-4d2d-b837-586337c85c34"). InnerVolumeSpecName "kube-api-access-q2vrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:27:15.138902 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138858 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fcccef9-d552-4d2d-b837-586337c85c34-istiod-ca-cert\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.139086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138918 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-data\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.139086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138931 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-istio-token\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.139086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138942 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fcccef9-d552-4d2d-b837-586337c85c34-istio-envoy\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.139086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138956 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fcccef9-d552-4d2d-b837-586337c85c34-istio-podinfo\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.139086 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.138967 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2vrp\" (UniqueName: \"kubernetes.io/projected/9fcccef9-d552-4d2d-b837-586337c85c34-kube-api-access-q2vrp\") on node \"ip-10-0-142-94.ec2.internal\" DevicePath \"\"" Jun 12 22:27:15.263732 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.263675 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:27:15.267676 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:15.267648 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fbdd64c0-openshift-default-7f875db666-6d4rn"] Jun 12 22:27:16.067353 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:27:16.067321 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" path="/var/lib/kubelet/pods/9fcccef9-d552-4d2d-b837-586337c85c34/volumes" Jun 12 22:30:16.334456 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:30:16.334350 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:30:16.346459 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:30:16.346437 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log" Jun 12 22:31:52.464758 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:52.464725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-699967dd46-jsmdr_c51b279a-2772-4e4b-bebf-81cdca64c04d/nginx/0.log" Jun 12 22:31:52.577189 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:52.577156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-5rfzh_277feba3-708a-4928-bf48-7fe67304ca25/manager/0.log" Jun 12 22:31:52.699482 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:52.699451 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7bpbp_5f07c388-a955-4505-813f-962925b575fa/manager/0.log" Jun 12 22:31:52.918782 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:52.918752 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688360-2gkmm_5b134fd0-56dc-4237-bdfa-c4b12dd875aa/cleanup/0.log" Jun 12 22:31:53.250433 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:53.250399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-774bccd4d7-4gd8c_ee4a887a-74ba-470a-ad70-69e2316ebd8a/manager/0.log" Jun 12 22:31:53.362895 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:53.362845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-jbwmh_cad94fc8-ea03-49f6-8282-62d7ebdd6526/server/0.log" Jun 12 22:31:53.825448 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:53.825420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9_eefea6d2-c49d-4c85-87b7-9135cc8a7f30/copy-manifests/0.log" Jun 12 22:31:53.851232 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:53.851198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9_eefea6d2-c49d-4c85-87b7-9135cc8a7f30/manager/0.log" Jun 12 22:31:54.712977 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.712943 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/util/0.log" Jun 12 22:31:54.719181 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.719148 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/pull/0.log" Jun 12 22:31:54.724510 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.724486 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/extract/0.log" Jun 12 22:31:54.837768 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.837738 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/util/0.log" Jun 12 22:31:54.844101 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.844080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/pull/0.log" Jun 12 22:31:54.849795 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.849767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/extract/0.log" Jun 12 22:31:54.962840 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.962812 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/pull/0.log" Jun 12 22:31:54.969004 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.968921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/extract/0.log" Jun 12 22:31:54.974719 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:54.974678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/util/0.log" Jun 12 22:31:55.086971 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:55.086939 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/pull/0.log" Jun 12 22:31:55.093461 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:55.093436 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/extract/0.log" Jun 12 22:31:55.099200 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:55.099175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/util/0.log" Jun 12 22:31:55.810503 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:55.810471 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r6qw8_02438fa0-c5d9-4e5e-a5e1-92ca42419562/manager/0.log" Jun 12 22:31:56.057371 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:56.057334 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7g5t5_f1537090-b623-4979-a5d1-2bd7f5d24ddd/manager/0.log" Jun 12 22:31:56.523648 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:56.523614 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-v8tp7_4640035f-08c6-4215-96d7-c5634db8473d/discovery/0.log" Jun 12 22:31:56.736469 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:56.736427 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b869f4f6-w7f6b_07b93271-e0b5-454e-b42f-d401e7220870/kube-auth-proxy/0.log" Jun 12 22:31:57.080353 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:57.080325 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4tgcw_d5ddb67e-cfe5-4257-bfde-e9214fde12d0/payload-processing/0.log" Jun 12 22:31:57.526026 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:57.525994 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc_7ebfd376-9793-4b32-b7de-0bcbb3cc42ae/storage-initializer/0.log" Jun 12 22:31:57.532349 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:57.532322 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hzdrc_7ebfd376-9793-4b32-b7de-0bcbb3cc42ae/main/0.log" Jun 12 22:31:57.883487 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:57.883390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7_f1cdb4a1-619c-467e-a34e-2b58d83e7880/storage-initializer/0.log" Jun 12 22:31:57.891087 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:57.891057 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c2k4v7_f1cdb4a1-619c-467e-a34e-2b58d83e7880/main/0.log" Jun 12 22:31:58.001556 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:58.001522 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb_a34451f1-7743-455a-a6a2-0e8d0d3e291a/main/0.log" Jun 12 22:31:58.007847 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:31:58.007816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2w9hb_a34451f1-7743-455a-a6a2-0e8d0d3e291a/storage-initializer/0.log" Jun 12 22:32:05.659788 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:05.659754 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2vl6w_3d78fa06-b3ee-4f88-9688-11658e599c76/global-pull-secret-syncer/0.log" Jun 12 22:32:05.869025 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:05.868990 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jdw86_07fe700f-fe90-4a7b-b29a-a5a34ff547ef/konnectivity-agent/0.log" Jun 12 22:32:05.943746 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:05.943645 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-94.ec2.internal_e800556701e0f3225594e9c8f5fee76a/haproxy/0.log" Jun 12 22:32:09.207360 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:09.207330 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-lc2cm_2e4b96d8-e089-4807-a83d-90b6ce79c960/sail-operator/0.log" Jun 12 22:32:10.675071 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.675032 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/extract/0.log" Jun 12 22:32:10.703554 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.703519 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/util/0.log" Jun 12 22:32:10.727726 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.727635 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f48g6_27c3086b-3bfe-404e-af59-d68cadfba362/pull/0.log" Jun 12 22:32:10.761200 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.761166 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/extract/0.log" Jun 12 22:32:10.781715 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.781651 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/util/0.log" Jun 12 22:32:10.803155 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.803123 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nhbjf_dc381f9d-a960-4475-be92-370a401368f3/pull/0.log" Jun 12 22:32:10.834707 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.834666 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/extract/0.log" Jun 12 22:32:10.858099 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.858067 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/util/0.log" Jun 12 22:32:10.878882 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.878852 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjvcw_0ecfa7ba-e249-4762-b1dc-d4462fdf644e/pull/0.log" Jun 12 22:32:10.914026 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.913996 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/extract/0.log" Jun 12 22:32:10.935226 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.935139 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/util/0.log" Jun 12 22:32:10.957739 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:10.957658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn2wp_ef650c15-31ae-4c31-bedb-006cb7128852/pull/0.log" Jun 12 22:32:11.488998 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:11.488965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r6qw8_02438fa0-c5d9-4e5e-a5e1-92ca42419562/manager/0.log" Jun 12 22:32:11.619730 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:11.619666 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7g5t5_f1537090-b623-4979-a5d1-2bd7f5d24ddd/manager/0.log" Jun 12 22:32:13.493973 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.493942 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6ff95d8589-hnrvt_b633e385-d6c1-463d-8ebd-ca37ba6eabaf/metrics-server/0.log" Jun 12 22:32:13.519917 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.519888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-gk2w9_641905c9-dc31-40ea-83bf-8c68a3b9e4f7/monitoring-plugin/0.log" Jun 12 22:32:13.560485 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.560446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wnv6_644fe6cd-548b-49ed-ac84-921de2a4e8f0/node-exporter/0.log" Jun 12 22:32:13.579804 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.579776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wnv6_644fe6cd-548b-49ed-ac84-921de2a4e8f0/kube-rbac-proxy/0.log" Jun 12 22:32:13.601113 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.601087 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wnv6_644fe6cd-548b-49ed-ac84-921de2a4e8f0/init-textfile/0.log" Jun 12 22:32:13.815010 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.814979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-nfg7q_6a226982-2249-4e90-a86b-49aa65eb6e60/kube-rbac-proxy-main/0.log" Jun 12 22:32:13.848781 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.848739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-nfg7q_6a226982-2249-4e90-a86b-49aa65eb6e60/kube-rbac-proxy-self/0.log" Jun 12 22:32:13.873670 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:13.873629 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-nfg7q_6a226982-2249-4e90-a86b-49aa65eb6e60/openshift-state-metrics/0.log" Jun 12 22:32:14.141327 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.141238 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qv5v7_43abdfb1-14b6-4b0e-98ea-997b3f07d73a/prometheus-operator/0.log" Jun 12 22:32:14.157826 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.157793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qv5v7_43abdfb1-14b6-4b0e-98ea-997b3f07d73a/kube-rbac-proxy/0.log" Jun 12 22:32:14.184002 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.183967 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-pt7dl_3e6cf365-2557-479b-90ac-611deebf2d84/prometheus-operator-admission-webhook/0.log" Jun 12 22:32:14.224618 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.224589 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f59f7657-4szkj_400d6242-4112-4f38-92fc-7a5783879b21/telemeter-client/0.log" Jun 12 22:32:14.246321 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.246296 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f59f7657-4szkj_400d6242-4112-4f38-92fc-7a5783879b21/reload/0.log" Jun 12 22:32:14.269929 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:14.269902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f59f7657-4szkj_400d6242-4112-4f38-92fc-7a5783879b21/kube-rbac-proxy/0.log" Jun 12 22:32:17.072189 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:17.072155 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78fb4f84b4-ct46l_babb9712-f3a7-4b87-9ea2-c531daf933a5/console/0.log" Jun 12 22:32:18.124604 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.124570 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb"] Jun 12 22:32:18.125358 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.125330 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" containerName="istio-proxy" Jun 12 22:32:18.125358 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.125357 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" containerName="istio-proxy" Jun 12 22:32:18.125552 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.125491 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fcccef9-d552-4d2d-b837-586337c85c34" containerName="istio-proxy" Jun 12 22:32:18.128934 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.128907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.131298 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.131275 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7vpzq\"/\"openshift-service-ca.crt\"" Jun 12 22:32:18.131424 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.131312 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7vpzq\"/\"default-dockercfg-v7vmg\"" Jun 12 22:32:18.131424 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.131276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7vpzq\"/\"kube-root-ca.crt\"" Jun 12 22:32:18.136823 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.136671 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb"] Jun 12 22:32:18.160188 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.160147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-sys\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.160344 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.160217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-podres\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.160344 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.160248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-proc\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.160344 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.160271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-lib-modules\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.160344 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.160318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9x4b\" (UniqueName: \"kubernetes.io/projected/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-kube-api-access-d9x4b\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261113 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-sys\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-podres\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-proc\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-lib-modules\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-sys\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9x4b\" (UniqueName: \"kubernetes.io/projected/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-kube-api-access-d9x4b\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261299 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261272 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-proc\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261499 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-podres\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.261499 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.261329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-lib-modules\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.269724 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.269680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9x4b\" (UniqueName: \"kubernetes.io/projected/33cc7f8b-87d6-49fa-81b4-b210a8ca6d48-kube-api-access-d9x4b\") pod \"perf-node-gather-daemonset-2jnkb\" (UID: \"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48\") " pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.440421 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.440311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.579811 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.579777 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb"] Jun 12 22:32:18.581207 ip-10-0-142-94 kubenswrapper[2565]: W0612 22:32:18.581179 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33cc7f8b_87d6_49fa_81b4_b210a8ca6d48.slice/crio-016c24892295e3af4a3476e28c80e213e8973708f0ffecfe80c8c107794b37b5 WatchSource:0}: Error finding container 016c24892295e3af4a3476e28c80e213e8973708f0ffecfe80c8c107794b37b5: Status 404 returned error can't find the container with id 016c24892295e3af4a3476e28c80e213e8973708f0ffecfe80c8c107794b37b5 Jun 12 22:32:18.782776 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.782741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" event={"ID":"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48","Type":"ContainerStarted","Data":"f78d193951fb638c2b1a64a5bcd608a46a7783c05ce8297773a3683202335840"} Jun 12 22:32:18.782964 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.782800 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" event={"ID":"33cc7f8b-87d6-49fa-81b4-b210a8ca6d48","Type":"ContainerStarted","Data":"016c24892295e3af4a3476e28c80e213e8973708f0ffecfe80c8c107794b37b5"} Jun 12 22:32:18.782964 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.782836 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:18.800649 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:18.800587 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" podStartSLOduration=0.800567489 podStartE2EDuration="800.567489ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:18.797305599 +0000 UTC m=+2823.240139964" watchObservedRunningTime="2026-06-12 22:32:18.800567489 +0000 UTC m=+2823.243401864" Jun 12 22:32:19.080975 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:19.080884 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74nrc_4871b802-03e3-4b95-a3f5-ea564a859d63/dns/0.log" Jun 12 22:32:19.103069 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:19.103040 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74nrc_4871b802-03e3-4b95-a3f5-ea564a859d63/kube-rbac-proxy/0.log" Jun 12 22:32:19.287126 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:19.287094 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mmqqv_5feaa91f-7d1c-4c1b-9925-6ff6fddfd98a/dns-node-resolver/0.log" Jun 12 22:32:19.908231 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:19.908198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hk7t4_9ae3d0f7-5181-472c-ad6f-c567d61c4033/node-ca/0.log" Jun 12 22:32:21.016019 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:21.015978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-v8tp7_4640035f-08c6-4215-96d7-c5634db8473d/discovery/0.log" Jun 12 22:32:21.065562 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:21.065524 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b869f4f6-w7f6b_07b93271-e0b5-454e-b42f-d401e7220870/kube-auth-proxy/0.log" Jun 12 22:32:21.267043 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:21.266928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4tgcw_d5ddb67e-cfe5-4257-bfde-e9214fde12d0/payload-processing/0.log" Jun 12 22:32:22.031557 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:22.031526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfkt4_febad53b-f672-4465-b313-71ba2278cabe/serve-healthcheck-canary/0.log" Jun 12 22:32:22.821992 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:22.821965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbfcp_4cd41736-8960-4f22-bd5b-8767abb60376/kube-rbac-proxy/0.log" Jun 12 22:32:22.848832 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:22.848793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbfcp_4cd41736-8960-4f22-bd5b-8767abb60376/exporter/0.log" Jun 12 22:32:22.871441 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:22.871404 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbfcp_4cd41736-8960-4f22-bd5b-8767abb60376/extractor/0.log" Jun 12 22:32:24.799097 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:24.799061 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7vpzq/perf-node-gather-daemonset-2jnkb" Jun 12 22:32:25.244396 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.244362 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-699967dd46-jsmdr_c51b279a-2772-4e4b-bebf-81cdca64c04d/nginx/0.log" Jun 12 22:32:25.270035 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.270002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-5rfzh_277feba3-708a-4928-bf48-7fe67304ca25/manager/0.log" Jun 12 22:32:25.392090 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.392047 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7bpbp_5f07c388-a955-4505-813f-962925b575fa/manager/0.log" Jun 12 22:32:25.446779 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.446743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688360-2gkmm_5b134fd0-56dc-4237-bdfa-c4b12dd875aa/cleanup/0.log" Jun 12 22:32:25.625027 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.624921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-774bccd4d7-4gd8c_ee4a887a-74ba-470a-ad70-69e2316ebd8a/manager/0.log" Jun 12 22:32:25.649335 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.649305 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-jbwmh_cad94fc8-ea03-49f6-8282-62d7ebdd6526/server/0.log" Jun 12 22:32:25.959813 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.959678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9_eefea6d2-c49d-4c85-87b7-9135cc8a7f30/manager/0.log" Jun 12 22:32:25.976284 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:25.976255 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4f54b9bb-8dmc9_eefea6d2-c49d-4c85-87b7-9135cc8a7f30/copy-manifests/0.log" Jun 12 22:32:27.594920 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:27.594885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pvpg2_bd4f2cd1-00fb-47ae-9cf9-7029a8d9f22d/openshift-lws-operator/0.log" Jun 12 22:32:31.890132 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:31.890098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-v8tp7_4640035f-08c6-4215-96d7-c5634db8473d/discovery/0.log" Jun 12 22:32:31.922950 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:31.922920 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b869f4f6-w7f6b_07b93271-e0b5-454e-b42f-d401e7220870/kube-auth-proxy/0.log" Jun 12 22:32:32.089753 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:32.089723 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4tgcw_d5ddb67e-cfe5-4257-bfde-e9214fde12d0/payload-processing/0.log" Jun 12 22:32:33.393847 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:33.393810 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-v8tp7_4640035f-08c6-4215-96d7-c5634db8473d/discovery/0.log" Jun 12 22:32:33.427384 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:33.427344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b869f4f6-w7f6b_07b93271-e0b5-454e-b42f-d401e7220870/kube-auth-proxy/0.log" Jun 12 22:32:33.586896 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:33.586851 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4tgcw_d5ddb67e-cfe5-4257-bfde-e9214fde12d0/payload-processing/0.log" Jun 12 22:32:35.428662 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.428631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-v8tp7_4640035f-08c6-4215-96d7-c5634db8473d/discovery/0.log" Jun 12 22:32:35.452656 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.452622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b869f4f6-w7f6b_07b93271-e0b5-454e-b42f-d401e7220870/kube-auth-proxy/0.log" Jun 12 22:32:35.522050 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.522023 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/kube-multus-additional-cni-plugins/0.log" Jun 12 22:32:35.545524 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.545477 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/egress-router-binary-copy/0.log" Jun 12 22:32:35.567465 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.567434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/cni-plugins/0.log" Jun 12 22:32:35.590681 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.590649 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/bond-cni-plugin/0.log" Jun 12 22:32:35.604858 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.604831 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4tgcw_d5ddb67e-cfe5-4257-bfde-e9214fde12d0/payload-processing/0.log" Jun 12 22:32:35.623864 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.623837 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/routeoverride-cni/0.log" Jun 12 22:32:35.648635 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.648613 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/whereabouts-cni-bincopy/0.log" Jun 12 22:32:35.669074 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.669050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn597_b3d67cac-b704-4582-b443-202482c6d4f0/whereabouts-cni/0.log" Jun 12 22:32:35.773245 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.773215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wjjkg_f8120340-2ad9-46d9-bf5e-102ecdc8884e/kube-multus/0.log" Jun 12 22:32:35.796093 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.796060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dpkvh_c5ad33cd-6c59-4344-ab98-0c3ef62f6afa/network-metrics-daemon/0.log" Jun 12 22:32:35.813562 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:35.813511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dpkvh_c5ad33cd-6c59-4344-ab98-0c3ef62f6afa/kube-rbac-proxy/0.log" Jun 12 22:32:37.144752 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:37.144632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-controller/0.log" Jun 12 22:32:37.165980 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:37.165932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/1.log" Jun 12 22:32:37.166215 ip-10-0-142-94 kubenswrapper[2565]: I0612 22:32:37.166046 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmkvf_f02a411a-46f3-4e19-bf2d-ec70999a6e63/ovn-acl-logging/0.log"