Jun 11 17:47:23.788464 ip-10-0-133-204 systemd[1]: Starting Kubernetes Kubelet... Jun 11 17:47:24.208187 ip-10-0-133-204 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 17:47:24.208187 ip-10-0-133-204 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 17:47:24.208187 ip-10-0-133-204 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 17:47:24.208187 ip-10-0-133-204 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 17:47:24.208187 ip-10-0-133-204 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 17:47:24.209543 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.208250 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 17:47:24.212544 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212527 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.212544 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212544 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212548 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212552 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212555 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212558 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212561 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212563 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212566 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212569 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212572 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212575 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212578 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212581 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212583 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212586 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212589 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212592 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212595 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212597 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212600 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.212611 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212602 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212606 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212608 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212611 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212613 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212617 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212621 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212625 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212628 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212631 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212636 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212639 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212642 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212644 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212647 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212650 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212653 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212655 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212658 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.213090 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212660 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212665 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212668 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212671 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212674 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212677 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212680 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212682 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212685 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212688 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212691 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212695 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212699 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212702 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212705 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212708 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212710 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212713 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212715 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.213560 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212718 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212721 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212724 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212726 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212729 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212731 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212734 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212736 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212739 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212741 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212744 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212747 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212749 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212752 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212754 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212756 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212759 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212762 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212765 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212768 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.214040 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212770 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212773 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212776 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212779 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212782 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212787 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212789 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212792 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212796 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212799 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212801 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212804 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212806 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212809 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212811 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212813 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212816 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212819 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.212822 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.214534 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213527 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213534 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213538 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213541 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213543 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213546 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213549 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213552 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213554 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213557 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213560 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213562 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213565 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213568 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213571 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213573 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213577 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213580 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213583 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213586 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.215037 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213589 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213592 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213594 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213597 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213600 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213602 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213605 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213608 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213610 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213613 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213615 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213618 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213620 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213623 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213625 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213628 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213630 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213633 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213635 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213638 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.215554 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213640 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213643 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213645 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213648 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213653 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213656 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213660 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213663 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213666 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213669 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213673 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213675 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213679 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213682 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213684 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213687 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213690 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213693 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213695 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213698 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.216033 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213700 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213703 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213706 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213708 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213711 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213713 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213716 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213718 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213721 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213724 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213726 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213729 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213731 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213733 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213736 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213738 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213741 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213744 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213747 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213749 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.216538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213752 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213754 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213757 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213760 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213763 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213765 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213768 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213771 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213774 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213776 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213779 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213783 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213786 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213789 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213792 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213794 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213798 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213802 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.213805 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.217036 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214165 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214188 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214192 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214194 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214197 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214200 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214202 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214205 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214208 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214211 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214216 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214218 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214221 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214223 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214226 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214229 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214233 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214237 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214240 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.217529 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214243 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214246 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214249 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214251 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214254 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214257 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214260 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214262 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214265 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214267 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214270 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214272 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214275 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214277 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214280 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214282 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214286 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214288 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214291 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214293 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.217981 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214296 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214298 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214301 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214305 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214307 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214310 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214312 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214315 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214318 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214320 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214324 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214327 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214329 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214332 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214334 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214337 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214340 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214342 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214345 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214349 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.218520 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214352 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214356 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214359 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214362 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214365 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214367 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214370 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214372 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214375 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214377 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214380 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214382 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214385 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214387 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214390 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214394 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214396 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214401 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214404 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.219049 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214408 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214411 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214414 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214417 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214420 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214422 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214425 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214428 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214432 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214435 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214437 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214440 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214442 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214445 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214448 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214450 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214453 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214455 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214458 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214460 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.219538 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.214463 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214526 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214533 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214539 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214543 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214547 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214550 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214554 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214561 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214565 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214568 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214572 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214575 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214578 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214581 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214584 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214587 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214590 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214593 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214597 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214601 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214604 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214607 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214611 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 17:47:24.220060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214614 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214617 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214620 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214623 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214626 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214629 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214632 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214642 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214646 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214650 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214653 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214656 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214659 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214661 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214664 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214668 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214672 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214675 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214678 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214680 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214684 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214687 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214691 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214693 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214696 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 17:47:24.220643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214699 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214702 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214705 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214709 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214712 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214715 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214719 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214721 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214724 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214728 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214730 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214733 2574 flags.go:64] FLAG: --help="false" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214736 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214739 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214743 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214745 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214749 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214752 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214755 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214758 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214760 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214763 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214766 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214769 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 17:47:24.221286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214773 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214776 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214779 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214782 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214785 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214787 2574 flags.go:64] FLAG: --lock-file="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214790 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214793 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214796 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214801 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214804 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214808 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214811 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214814 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214817 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214820 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214823 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214827 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214830 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214834 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214837 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214839 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214842 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214845 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214848 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 17:47:24.221887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214851 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214854 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214860 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214863 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214866 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214869 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214872 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214878 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214880 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214883 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214886 2574 flags.go:64] FLAG: --port="10250" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214889 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214892 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002507a554f2763d0" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214895 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214898 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214900 2574 flags.go:64] FLAG: --register-node="true" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214903 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214907 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214911 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214914 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214917 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214920 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214923 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214926 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214928 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 17:47:24.222527 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214931 2574 flags.go:64] FLAG: --runonce="false" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214934 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214937 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214940 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214942 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214945 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214948 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214951 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214956 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214959 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214962 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214965 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214967 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214970 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214973 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214976 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214981 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214984 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214986 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214990 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214993 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214996 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.214998 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215001 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215004 2574 flags.go:64] FLAG: --v="2" Jun 11 17:47:24.223149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215009 2574 flags.go:64] FLAG: --version="false" Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215014 2574 flags.go:64] FLAG: --vmodule="" Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215018 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.215021 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215134 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215138 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215142 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215144 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215147 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215151 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215154 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215156 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215159 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215162 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215165 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215182 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215185 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215187 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215190 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215193 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215196 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.223808 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215199 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215203 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215206 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215209 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215213 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215215 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215218 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215221 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215224 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215226 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215229 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215233 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215236 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215240 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215242 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215245 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215247 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215250 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215253 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.224336 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215256 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215258 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215261 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215263 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215266 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215268 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215271 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215275 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215277 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215281 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215285 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215288 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215291 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215293 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215296 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215298 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215301 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215304 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215306 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.224794 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215309 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215312 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215314 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215317 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215320 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215324 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215327 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215329 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215332 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215335 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215337 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215340 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215342 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215345 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215348 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215351 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215353 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215356 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215358 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215361 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.225278 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215365 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215367 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215370 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215373 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215375 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215378 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215380 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215383 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215387 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215390 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215392 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215395 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215398 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215400 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215403 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215406 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215409 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215413 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215415 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.225750 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215418 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215421 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215429 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215432 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.215435 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.216124 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223076 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223089 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223102 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223107 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223164 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223183 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223189 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223192 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223195 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.226270 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223198 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223202 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223207 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223210 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223212 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223215 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223218 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223221 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223224 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223226 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223229 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223232 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223235 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223237 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223240 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223242 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223245 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223247 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223250 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.226680 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223254 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223258 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223261 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223264 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223267 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223270 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223274 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223277 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223279 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223282 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223285 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223288 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223290 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223293 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223295 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223298 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223300 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223303 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223306 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.227155 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223308 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223311 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223314 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223316 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223319 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223321 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223324 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223326 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223329 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223332 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223334 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223337 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223339 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223342 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223345 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223347 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223350 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223353 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223356 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223359 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.227627 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223362 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223365 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223367 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223370 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223372 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223375 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223377 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223380 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223382 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223385 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223387 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223390 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223392 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223395 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223397 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223400 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223402 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223406 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223409 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223412 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.228125 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223414 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223417 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223419 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223422 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223424 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223427 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223429 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223432 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223435 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223438 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223440 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223444 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223447 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223450 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223452 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.228628 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223455 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223460 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223566 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223570 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223573 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223576 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223579 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223581 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223584 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223587 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223589 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223592 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223594 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223597 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223599 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 17:47:24.229004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223602 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223604 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223607 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223609 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223611 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223614 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223617 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223619 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223622 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223624 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223628 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223631 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223633 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223636 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223639 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223641 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223644 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223648 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223651 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 17:47:24.229411 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223654 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223657 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223660 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223663 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223666 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223668 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223671 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223674 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223676 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223679 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223682 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223684 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223687 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223689 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223692 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223695 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223697 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223700 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223702 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223705 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 17:47:24.229874 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223708 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223710 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223712 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223715 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223721 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223724 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223726 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223729 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223733 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223736 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223738 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223741 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223743 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223746 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223748 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223752 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223756 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223758 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223761 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 17:47:24.230381 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223764 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223766 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223769 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223771 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223774 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223776 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223778 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223781 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223784 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223786 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223788 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223791 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223793 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223796 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223799 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223802 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223804 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223807 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223810 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223813 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 17:47:24.230848 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223816 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223819 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223822 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223824 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223827 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223830 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223832 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:24.223835 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223840 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.223929 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.226024 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.227593 2574 server.go:1019] "Starting client certificate rotation" Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.227692 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.227729 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 17:47:24.231414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.230448 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 17:47:24.235651 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.235629 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 17:47:24.248870 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.248847 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 17:47:24.253023 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.253010 2574 log.go:25] "Validated CRI v1 image API" Jun 11 17:47:24.253767 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.253751 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 17:47:24.256439 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.256418 2574 fs.go:135] Filesystem UUIDs: map[2c92c66a-6d09-4a14-9a05-3527035198d8:/dev/nvme0n1p3 314396f7-5061-49fb-8c65-94e40dd20c3c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 17:47:24.256501 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.256439 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 17:47:24.261894 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.261795 2574 manager.go:216] Machine: {Timestamp:2026-06-11 17:47:24.260127808 +0000 UTC m=+0.354221305 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092015 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27675257a763cf6f1d7b42302f8fed SystemUUID:ec276752-57a7-63cf-6f1d-7b42302f8fed BootID:f75311c4-f4f8-4d83-9094-5b10e7d5f862 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:fb:85:99:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:fb:85:99:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:0f:0e:d0:53:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 17:47:24.261894 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.261893 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 17:47:24.261996 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.261964 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 17:47:24.267223 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.267200 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 17:47:24.267362 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.267227 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 17:47:24.267999 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.267990 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 17:47:24.268029 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.268002 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 17:47:24.268029 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.268009 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 17:47:24.268750 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.268740 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 17:47:24.268895 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.268881 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 17:47:24.270081 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.270070 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 17:47:24.274341 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274330 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 17:47:24.274443 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274434 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 17:47:24.274471 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274465 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 17:47:24.274514 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274475 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 17:47:24.274514 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274489 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 17:47:24.274514 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274498 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 17:47:24.274645 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274529 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 17:47:24.274980 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274967 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 17:47:24.275022 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.274986 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 17:47:24.277241 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.277220 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 17:47:24.280093 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280075 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 17:47:24.280241 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280120 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 17:47:24.280815 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280792 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 17:47:24.280815 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280820 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 17:47:24.280932 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280841 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 17:47:24.280932 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280852 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 17:47:24.280932 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280865 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 17:47:24.280932 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.280874 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 17:47:24.282085 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282073 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 17:47:24.282188 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282095 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 17:47:24.282188 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282132 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 17:47:24.282188 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282150 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 17:47:24.282188 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282188 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 17:47:24.282358 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.282221 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 17:47:24.283792 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.283777 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 17:47:24.283837 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.283831 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 17:47:24.287056 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.287038 2574 server.go:1268] "Started kubelet" Jun 11 17:47:24.287148 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.287111 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 17:47:24.287243 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.287122 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 17:47:24.287243 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.287213 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 17:47:24.287931 ip-10-0-133-204 systemd[1]: Started Kubernetes Kubelet. Jun 11 17:47:24.288963 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.288943 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 17:47:24.289367 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.289355 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 17:47:24.290743 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.290724 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 17:47:24.291047 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.291024 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 17:47:24.291101 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.291078 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 17:47:24.294871 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.294854 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 17:47:24.294952 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.294920 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 17:47:24.295018 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.295004 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.295659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.295640 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 17:47:24.295659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.295645 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 17:47:24.295791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.295670 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 17:47:24.295841 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.295803 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 17:47:24.295841 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.295814 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 17:47:24.295931 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.295888 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 17:47:24.296069 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296051 2574 factory.go:153] Registering CRI-O factory Jun 11 17:47:24.296164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296073 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 17:47:24.296164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296123 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 17:47:24.296164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296132 2574 factory.go:55] Registering systemd factory Jun 11 17:47:24.296164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296140 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 17:47:24.296164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296162 2574 factory.go:103] Registering Raw factory Jun 11 17:47:24.296383 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296200 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 17:47:24.297339 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.296671 2574 manager.go:349] Starting recovery of all containers Jun 11 17:47:24.298733 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.298705 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 17:47:24.298854 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.298833 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 17:47:24.299576 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.298391 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800c9a329fb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.287011323 +0000 UTC m=+0.381104819,LastTimestamp:2026-06-11 17:47:24.287011323 +0000 UTC m=+0.381104819,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.309552 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.309537 2574 manager.go:354] Recovery completed Jun 11 17:47:24.313577 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.313564 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.315353 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315337 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.315421 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315368 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.315421 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315384 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.315853 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315840 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 17:47:24.315853 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315852 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 17:47:24.315930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315854 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.315930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.315868 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 17:47:24.316519 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.316506 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.316591 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.316533 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.316591 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.316547 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.317823 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.317810 2574 policy_none.go:49] "None policy: Start" Jun 11 17:47:24.317883 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.317826 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 17:47:24.317883 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.317836 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 17:47:24.319361 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.319350 2574 policy_none.go:47] "Start" Jun 11 17:47:24.322400 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.322329 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb539f40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315352896 +0000 UTC m=+0.409446402,LastTimestamp:2026-06-11 17:47:24.315352896 +0000 UTC m=+0.409446402,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.345865 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.345806 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb53fab3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315376307 +0000 UTC m=+0.409469811,LastTimestamp:2026-06-11 17:47:24.315376307 +0000 UTC m=+0.409469811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.354748 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.354730 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.354775 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.354786 2574 server.go:87] "Starting device plugin registration server" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.354987 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.354997 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.355108 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.355214 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.355223 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.355874 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.355914 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.359301 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb54323d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315390525 +0000 UTC m=+0.409484025,LastTimestamp:2026-06-11 17:47:24.315390525 +0000 UTC m=+0.409484025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.368057 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.369253 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.369292 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.369312 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.369348 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.378435 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 11 17:47:24.381879 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.380430 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-204.ec2.internal.18b81800cb539f40\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb539f40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315352896 +0000 UTC m=+0.409446402,LastTimestamp:2026-06-11 17:47:24.316518717 +0000 UTC m=+0.410612233,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.385232 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.385162 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-204.ec2.internal.18b81800cb53fab3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb53fab3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315376307 +0000 UTC m=+0.409469811,LastTimestamp:2026-06-11 17:47:24.316539326 +0000 UTC m=+0.410632824,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.400945 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.400882 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-204.ec2.internal.18b81800cb54323d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cb54323d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-204.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.315390525 +0000 UTC m=+0.409484025,LastTimestamp:2026-06-11 17:47:24.316552826 +0000 UTC m=+0.410646324,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.401740 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.401723 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xkjmx" Jun 11 17:47:24.412909 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.412851 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-204.ec2.internal.18b81800cdcc48a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-204.ec2.internal,UID:ip-10-0-133-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-133-204.ec2.internal,},FirstTimestamp:2026-06-11 17:47:24.35681501 +0000 UTC m=+0.450908494,LastTimestamp:2026-06-11 17:47:24.35681501 +0000 UTC m=+0.450908494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-204.ec2.internal,}" Jun 11 17:47:24.414786 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.414771 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xkjmx" Jun 11 17:47:24.455954 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.455938 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.456664 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.456649 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.456734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.456677 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.456734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.456686 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.456734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.456708 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.469475 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.469420 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal"] Jun 11 17:47:24.469549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.469481 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.470196 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.470167 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.470266 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.470207 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.470266 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.470217 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.472336 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472323 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.472458 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.472493 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472475 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.472967 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472944 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.473090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472980 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.473090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472990 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.473090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.472945 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.473090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.473050 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.473090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.473061 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.473863 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.473848 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.473917 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.473874 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-204.ec2.internal\": node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.475376 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.475361 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.475438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.475387 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 17:47:24.476044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.476020 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientMemory" Jun 11 17:47:24.476044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.476044 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 17:47:24.476143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.476058 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeHasSufficientPID" Jun 11 17:47:24.497094 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.497065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.497204 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.497103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.497204 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.497121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df5acc5da7deed969d9d6b9c58d33ee0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-204.ec2.internal\" (UID: \"df5acc5da7deed969d9d6b9c58d33ee0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.505334 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.505314 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.505695 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.505679 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-204.ec2.internal\" not found" node="ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.510775 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.510758 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-204.ec2.internal\" not found" node="ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598078 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df5acc5da7deed969d9d6b9c58d33ee0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-204.ec2.internal\" (UID: \"df5acc5da7deed969d9d6b9c58d33ee0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598078 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598126 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df5acc5da7deed969d9d6b9c58d33ee0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-204.ec2.internal\" (UID: \"df5acc5da7deed969d9d6b9c58d33ee0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.598255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.598158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b4e615cdb5d351585ce56dbf7bd7878-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal\" (UID: \"9b4e615cdb5d351585ce56dbf7bd7878\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.605672 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.605655 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.706183 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.706142 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.807025 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.806961 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:24.810117 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.810094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.816384 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:24.816369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:24.907578 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:24.907544 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:25.008017 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:25.007990 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:25.108627 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:25.108550 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:25.209146 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:25.209116 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:25.227294 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.227267 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 17:47:25.309780 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:25.309759 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-204.ec2.internal\" not found" Jun 11 17:47:25.336893 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.336872 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 17:47:25.395968 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.395936 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" Jun 11 17:47:25.410359 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.410338 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 17:47:25.412593 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.412569 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" Jun 11 17:47:25.419733 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.419711 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 17:47:25.421721 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.421695 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 17:42:24 +0000 UTC" deadline="2028-01-26 19:19:13.467594476 +0000 UTC" Jun 11 17:47:25.421721 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.421720 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14257h31m48.04587759s" Jun 11 17:47:25.421995 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.421984 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 17:47:25.514805 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:25.514660 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5acc5da7deed969d9d6b9c58d33ee0.slice/crio-83e1da2d8213cb39c61feeeb2f4ecb41282ed725a14390186d6a82a3213e10f5 WatchSource:0}: Error finding container 83e1da2d8213cb39c61feeeb2f4ecb41282ed725a14390186d6a82a3213e10f5: Status 404 returned error can't find the container with id 83e1da2d8213cb39c61feeeb2f4ecb41282ed725a14390186d6a82a3213e10f5 Jun 11 17:47:25.515104 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:25.515085 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4e615cdb5d351585ce56dbf7bd7878.slice/crio-f8dc997c37dcc1dd26c848efdbada1410b1bce700c4a776b1e19fdc0321cdb96 WatchSource:0}: Error finding container f8dc997c37dcc1dd26c848efdbada1410b1bce700c4a776b1e19fdc0321cdb96: Status 404 returned error can't find the container with id f8dc997c37dcc1dd26c848efdbada1410b1bce700c4a776b1e19fdc0321cdb96 Jun 11 17:47:25.519180 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.519148 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:47:25.551436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.551414 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 17:47:25.588008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:25.587988 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 17:47:26.275948 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.275911 2574 apiserver.go:52] "Watching apiserver" Jun 11 17:47:26.284695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.284671 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 17:47:26.286288 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.286259 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-mg76q","openshift-multus/network-metrics-daemon-4v2rl","openshift-network-diagnostics/network-check-target-lw8x4","openshift-network-operator/iptables-alerter-xzfs9","kube-system/konnectivity-agent-lqjcd","kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jsh8x","openshift-dns/node-resolver-f8p7p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-frlrn","kube-system/global-pull-secret-syncer-6t52c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj","openshift-image-registry/node-ca-rb8j9","openshift-multus/multus-additional-cni-plugins-9lfcn"] Jun 11 17:47:26.288954 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.288781 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.291109 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.291007 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.291875 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.291852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dwt9s\"" Jun 11 17:47:26.292092 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.292075 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.292194 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.292155 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.293257 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.293235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:26.293342 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.293324 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:26.293812 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.293787 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 17:47:26.294007 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.293991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.294345 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.294320 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bk5xn\"" Jun 11 17:47:26.294548 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.294531 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.295220 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.295200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.295638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.295580 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 17:47:26.299549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.298989 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.299549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.299062 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.299549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.299116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 17:47:26.299549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.299196 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkkpc\"" Jun 11 17:47:26.299549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.299475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.301340 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.301321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.302762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.302741 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 17:47:26.303001 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.302983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xnkw7\"" Jun 11 17:47:26.303240 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.303223 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 17:47:26.303322 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.303312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.303869 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.303851 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nkhrb\"" Jun 11 17:47:26.303869 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.303864 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 17:47:26.304002 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.303888 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.304150 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.304135 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 17:47:26.304495 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.304357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 17:47:26.304600 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.304590 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305521 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9x82\" (UniqueName: \"kubernetes.io/projected/d47c06f4-a40c-4ac8-8181-d58333183ad1-kube-api-access-j9x82\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-modprobe-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-kubernetes\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-run\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-sys\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-lib-modules\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d47c06f4-a40c-4ac8-8181-d58333183ad1-serviceca\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8966178f-9c53-4d4c-ab20-4fc630de5e8f-host-slash\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysconfig\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-systemd\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-tuned\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d47c06f4-a40c-4ac8-8181-d58333183ad1-host\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8966178f-9c53-4d4c-ab20-4fc630de5e8f-iptables-alerter-script\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.305937 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4fb0f4-66d7-44c1-960e-52d9f994435f-konnectivity-ca\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-var-lib-kubelet\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4hc2\" (UniqueName: \"kubernetes.io/projected/8966178f-9c53-4d4c-ab20-4fc630de5e8f-kube-api-access-x4hc2\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4fb0f4-66d7-44c1-960e-52d9f994435f-agent-certs\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-conf\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.305988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-host\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.306010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-tmp\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.306032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6tgk\" (UniqueName: \"kubernetes.io/projected/f61b3a1b-1c41-440b-8e32-126482a2a2cc-kube-api-access-n6tgk\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.306483 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.306791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.306677 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.307226 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.306854 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z6m54\"" Jun 11 17:47:26.307957 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.307588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.307957 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.307648 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:26.307957 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.307818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 17:47:26.308410 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.308384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zf9zc\"" Jun 11 17:47:26.310117 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.309822 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 17:47:26.310236 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.310185 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.312293 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.312274 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.312393 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.312371 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:26.313784 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.313769 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.314511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.314493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.315020 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.315347 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315329 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 17:47:26.315489 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315475 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 17:47:26.315542 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315517 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 17:47:26.315713 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315695 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bv9ts\"" Jun 11 17:47:26.315842 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.315701 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 17:47:26.317445 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.317428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zdmqm\"" Jun 11 17:47:26.317534 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.317489 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 17:47:26.317738 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.317723 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 17:47:26.317792 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.317759 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 17:47:26.339817 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.339795 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fbv9r" Jun 11 17:47:26.352576 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.352558 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fbv9r" Jun 11 17:47:26.375341 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.375260 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" event={"ID":"9b4e615cdb5d351585ce56dbf7bd7878","Type":"ContainerStarted","Data":"f8dc997c37dcc1dd26c848efdbada1410b1bce700c4a776b1e19fdc0321cdb96"} Jun 11 17:47:26.378046 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.378020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" event={"ID":"df5acc5da7deed969d9d6b9c58d33ee0","Type":"ContainerStarted","Data":"83e1da2d8213cb39c61feeeb2f4ecb41282ed725a14390186d6a82a3213e10f5"} Jun 11 17:47:26.396852 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.396831 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 17:47:26.406389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-node-log\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.406389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4fb0f4-66d7-44c1-960e-52d9f994435f-agent-certs\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.406389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-os-release\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.406389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-multus\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-daemon-config\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-systemd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-sys-fs\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-os-release\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6tgk\" (UniqueName: \"kubernetes.io/projected/f61b3a1b-1c41-440b-8e32-126482a2a2cc-kube-api-access-n6tgk\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjmw7\" (UniqueName: \"kubernetes.io/projected/53c40270-3cc5-4ebd-aca2-e6e9de611350-kube-api-access-mjmw7\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-kubelet\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-registration-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnjp\" (UniqueName: \"kubernetes.io/projected/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kube-api-access-grnjp\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.406695 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.407211 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d47c06f4-a40c-4ac8-8181-d58333183ad1-serviceca\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.407211 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8966178f-9c53-4d4c-ab20-4fc630de5e8f-host-slash\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.407211 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-etc-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.407211 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.406866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8966178f-9c53-4d4c-ab20-4fc630de5e8f-host-slash\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.407392 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.407346 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 17:47:26.408030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.407729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rbdk\" (UniqueName: \"kubernetes.io/projected/a6581553-8e92-48e5-9ad6-d80f6da12f7b-kube-api-access-7rbdk\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.408030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.407838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-systemd\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.408030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.407939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d47c06f4-a40c-4ac8-8181-d58333183ad1-serviceca\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.408228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-systemd\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.408228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d47c06f4-a40c-4ac8-8181-d58333183ad1-host\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.408228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-cnibin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.408228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-socket-dir-parent\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.408228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-k8s-cni-cncf-io\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99fa751d-c4b6-490b-aa65-cb8b85e02175-hosts-file\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-systemd-units\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-ovn\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-kubelet-config\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-host\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-tmp\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.408455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-bin\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408568 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jf6n\" (UniqueName: \"kubernetes.io/projected/b18b883f-be77-4fe5-892e-e599d3c0993e-kube-api-access-6jf6n\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-kubernetes\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.408862 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-lib-modules\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-netns\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-var-lib-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-host\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5sck\" (UniqueName: \"kubernetes.io/projected/99fa751d-c4b6-490b-aa65-cb8b85e02175-kube-api-access-p5sck\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.409115 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8966178f-9c53-4d4c-ab20-4fc630de5e8f-iptables-alerter-script\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.409391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-kubelet\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.409391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-netd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.409391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-config\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.409391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-env-overrides\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-log-socket\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-bin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-slash\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-script-lib\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9x82\" (UniqueName: \"kubernetes.io/projected/d47c06f4-a40c-4ac8-8181-d58333183ad1-kube-api-access-j9x82\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-etc-kubernetes\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-system-cni-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-run\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-sys\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.409972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-multus-certs\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18b883f-be77-4fe5-892e-e599d3c0993e-ovn-node-metrics-cert\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.413349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fa751d-c4b6-490b-aa65-cb8b85e02175-tmp-dir\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-var-lib-kubelet\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4hc2\" (UniqueName: \"kubernetes.io/projected/8966178f-9c53-4d4c-ab20-4fc630de5e8f-kube-api-access-x4hc2\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-cni-binary-copy\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-hostroot\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-conf\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-system-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-conf-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlmv\" (UniqueName: \"kubernetes.io/projected/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-kube-api-access-9tlmv\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-netns\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cnibin\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-dbus\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-modprobe-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4fb0f4-66d7-44c1-960e-52d9f994435f-konnectivity-ca\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-device-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.414213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysconfig\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-tuned\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.410844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-socket-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411094 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-lib-modules\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-kubernetes\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.408567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d47c06f4-a40c-4ac8-8181-d58333183ad1-host\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8966178f-9c53-4d4c-ab20-4fc630de5e8f-iptables-alerter-script\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-run\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.411865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-sys\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.412038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysctl-conf\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.412089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-modprobe-d\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.412562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4fb0f4-66d7-44c1-960e-52d9f994435f-konnectivity-ca\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.412700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-var-lib-kubelet\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.412772 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-sysconfig\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.413189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-tmp\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.415011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.413997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4fb0f4-66d7-44c1-960e-52d9f994435f-agent-certs\") pod \"konnectivity-agent-lqjcd\" (UID: \"7e4fb0f4-66d7-44c1-960e-52d9f994435f\") " pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.415759 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.415483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f61b3a1b-1c41-440b-8e32-126482a2a2cc-etc-tuned\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.416417 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.416397 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:26.416494 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.416423 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:26.416494 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.416436 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:26.416607 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.416501 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:26.916482151 +0000 UTC m=+3.010575648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:26.419906 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.419885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9x82\" (UniqueName: \"kubernetes.io/projected/d47c06f4-a40c-4ac8-8181-d58333183ad1-kube-api-access-j9x82\") pod \"node-ca-rb8j9\" (UID: \"d47c06f4-a40c-4ac8-8181-d58333183ad1\") " pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.423753 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.423725 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4hc2\" (UniqueName: \"kubernetes.io/projected/8966178f-9c53-4d4c-ab20-4fc630de5e8f-kube-api-access-x4hc2\") pod \"iptables-alerter-xzfs9\" (UID: \"8966178f-9c53-4d4c-ab20-4fc630de5e8f\") " pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.424410 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.424196 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6tgk\" (UniqueName: \"kubernetes.io/projected/f61b3a1b-1c41-440b-8e32-126482a2a2cc-kube-api-access-n6tgk\") pod \"tuned-jsh8x\" (UID: \"f61b3a1b-1c41-440b-8e32-126482a2a2cc\") " pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.511689 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-bin\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jf6n\" (UniqueName: \"kubernetes.io/projected/b18b883f-be77-4fe5-892e-e599d3c0993e-kube-api-access-6jf6n\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-netns\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511793 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.511830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-var-lib-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-bin\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5sck\" (UniqueName: \"kubernetes.io/projected/99fa751d-c4b6-490b-aa65-cb8b85e02175-kube-api-access-p5sck\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-var-lib-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-kubelet\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-netns\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.511821 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-netd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-config\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.511976 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:27.011958394 +0000 UTC m=+3.106051878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.511994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-env-overrides\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-log-socket\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-bin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-slash\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512090 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-script-lib\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-log-socket\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512215 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-kubelet\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-etc-kubernetes\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-system-cni-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-etc-kubernetes\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-multus-certs\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18b883f-be77-4fe5-892e-e599d3c0993e-ovn-node-metrics-cert\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.512380 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:26.512436 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:27.01242142 +0000 UTC m=+3.106514906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-bin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fa751d-c4b6-490b-aa65-cb8b85e02175-tmp-dir\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.512971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-cni-binary-copy\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-cni-netd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-multus-certs\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512531 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-config\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-system-cni-dir\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-env-overrides\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-hostroot\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-system-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-conf-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-hostroot\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlmv\" (UniqueName: \"kubernetes.io/projected/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-kube-api-access-9tlmv\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-netns\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512803 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-system-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cnibin\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fa751d-c4b6-490b-aa65-cb8b85e02175-tmp-dir\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-dbus\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.513797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18b883f-be77-4fe5-892e-e599d3c0993e-ovnkube-script-lib\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-ovn-kubernetes\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-slash\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512974 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-conf-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.512977 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-run-netns\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cnibin\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-dbus\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-device-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-cni-dir\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513094 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-cni-binary-copy\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513107 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-device-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-socket-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-node-log\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-node-log\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-os-release\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-socket-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-multus\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.514699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-os-release\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-daemon-config\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-var-lib-cni-multus\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-systemd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-sys-fs\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-os-release\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-systemd\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjmw7\" (UniqueName: \"kubernetes.io/projected/53c40270-3cc5-4ebd-aca2-e6e9de611350-kube-api-access-mjmw7\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-sys-fs\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-kubelet\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6581553-8e92-48e5-9ad6-d80f6da12f7b-os-release\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-host-kubelet\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-registration-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnjp\" (UniqueName: \"kubernetes.io/projected/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kube-api-access-grnjp\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-registration-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.515616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-etc-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rbdk\" (UniqueName: \"kubernetes.io/projected/a6581553-8e92-48e5-9ad6-d80f6da12f7b-kube-api-access-7rbdk\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-cnibin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-socket-dir-parent\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-k8s-cni-cncf-io\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99fa751d-c4b6-490b-aa65-cb8b85e02175-hosts-file\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-cnibin\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-systemd-units\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-daemon-config\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-systemd-units\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-ovn\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-kubelet-config\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513818 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99fa751d-c4b6-490b-aa65-cb8b85e02175-hosts-file\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-etc-openvswitch\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-multus-socket-dir-parent\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53c40270-3cc5-4ebd-aca2-e6e9de611350-host-run-k8s-cni-cncf-io\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.516432 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18b883f-be77-4fe5-892e-e599d3c0993e-run-ovn\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.517217 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.513921 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc27922-4bdf-41bc-9c57-f03234d46b89-kubelet-config\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:26.517217 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.514054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.517217 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.514208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6581553-8e92-48e5-9ad6-d80f6da12f7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.517217 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.515912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18b883f-be77-4fe5-892e-e599d3c0993e-ovn-node-metrics-cert\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.520931 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.520662 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jf6n\" (UniqueName: \"kubernetes.io/projected/b18b883f-be77-4fe5-892e-e599d3c0993e-kube-api-access-6jf6n\") pod \"ovnkube-node-frlrn\" (UID: \"b18b883f-be77-4fe5-892e-e599d3c0993e\") " pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.522290 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.522267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5sck\" (UniqueName: \"kubernetes.io/projected/99fa751d-c4b6-490b-aa65-cb8b85e02175-kube-api-access-p5sck\") pod \"node-resolver-f8p7p\" (UID: \"99fa751d-c4b6-490b-aa65-cb8b85e02175\") " pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.522530 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.522486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnjp\" (UniqueName: \"kubernetes.io/projected/ff656541-a58e-484e-b1a6-db93a0e6b7cd-kube-api-access-grnjp\") pod \"aws-ebs-csi-driver-node-v9mxj\" (UID: \"ff656541-a58e-484e-b1a6-db93a0e6b7cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:26.522620 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.522588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjmw7\" (UniqueName: \"kubernetes.io/projected/53c40270-3cc5-4ebd-aca2-e6e9de611350-kube-api-access-mjmw7\") pod \"multus-mg76q\" (UID: \"53c40270-3cc5-4ebd-aca2-e6e9de611350\") " pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.523789 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.523768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlmv\" (UniqueName: \"kubernetes.io/projected/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-kube-api-access-9tlmv\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:26.523926 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.523887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rbdk\" (UniqueName: \"kubernetes.io/projected/a6581553-8e92-48e5-9ad6-d80f6da12f7b-kube-api-access-7rbdk\") pod \"multus-additional-cni-plugins-9lfcn\" (UID: \"a6581553-8e92-48e5-9ad6-d80f6da12f7b\") " pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.602367 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.602340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" Jun 11 17:47:26.611252 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.611234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rb8j9" Jun 11 17:47:26.621857 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.621840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzfs9" Jun 11 17:47:26.629225 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.629209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:26.636980 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.636958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" Jun 11 17:47:26.644610 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.644590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8p7p" Jun 11 17:47:26.659254 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.659095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mg76q" Jun 11 17:47:26.666817 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.666775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:26.673405 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:26.673385 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" Jun 11 17:47:27.016614 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:27.016577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:27.016805 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:27.016630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:27.016805 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:27.016676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:27.016805 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016759 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:27.016805 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016788 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:27.016805 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016801 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:27.017042 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016814 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:27.017042 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016852 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:27.017042 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016868 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:28.016849184 +0000 UTC m=+4.110942669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:27.017042 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016888 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:28.016879088 +0000 UTC m=+4.110972572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:27.017042 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:27.016906 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:28.016895507 +0000 UTC m=+4.110988991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:27.356570 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:27.356481 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 17:42:26 +0000 UTC" deadline="2028-03-19 15:48:03.972176006 +0000 UTC" Jun 11 17:47:27.356570 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:27.356525 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15526h0m36.615653445s" Jun 11 17:47:27.604688 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.604660 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fa751d_c4b6_490b_aa65_cb8b85e02175.slice/crio-551e6ed054c26af87e775addf5402ac11a93f361104d08ab3f6ddef1e1360918 WatchSource:0}: Error finding container 551e6ed054c26af87e775addf5402ac11a93f361104d08ab3f6ddef1e1360918: Status 404 returned error can't find the container with id 551e6ed054c26af87e775addf5402ac11a93f361104d08ab3f6ddef1e1360918 Jun 11 17:47:27.606347 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.606315 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c40270_3cc5_4ebd_aca2_e6e9de611350.slice/crio-f9793b85ab576053cfabd3a0563d22833b00f5bd0def6a38b8957ef764c399a4 WatchSource:0}: Error finding container f9793b85ab576053cfabd3a0563d22833b00f5bd0def6a38b8957ef764c399a4: Status 404 returned error can't find the container with id f9793b85ab576053cfabd3a0563d22833b00f5bd0def6a38b8957ef764c399a4 Jun 11 17:47:27.609803 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.609768 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4fb0f4_66d7_44c1_960e_52d9f994435f.slice/crio-375fdce8608bf98dc826a643f3332e7401ae0fb39c86104ffe312e40bce543e3 WatchSource:0}: Error finding container 375fdce8608bf98dc826a643f3332e7401ae0fb39c86104ffe312e40bce543e3: Status 404 returned error can't find the container with id 375fdce8608bf98dc826a643f3332e7401ae0fb39c86104ffe312e40bce543e3 Jun 11 17:47:27.610609 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.610534 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff656541_a58e_484e_b1a6_db93a0e6b7cd.slice/crio-2bfcd60c538d7b72bb559c93298ea131d3e19e6745a32b642bcebf58294d9372 WatchSource:0}: Error finding container 2bfcd60c538d7b72bb559c93298ea131d3e19e6745a32b642bcebf58294d9372: Status 404 returned error can't find the container with id 2bfcd60c538d7b72bb559c93298ea131d3e19e6745a32b642bcebf58294d9372 Jun 11 17:47:27.611647 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.611551 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47c06f4_a40c_4ac8_8181_d58333183ad1.slice/crio-a81c0a2a0fd37aed491717375e0d223549bfca8e2cc1df84c95bc1dcf27af7dd WatchSource:0}: Error finding container a81c0a2a0fd37aed491717375e0d223549bfca8e2cc1df84c95bc1dcf27af7dd: Status 404 returned error can't find the container with id a81c0a2a0fd37aed491717375e0d223549bfca8e2cc1df84c95bc1dcf27af7dd Jun 11 17:47:27.613555 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:47:27.613532 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6581553_8e92_48e5_9ad6_d80f6da12f7b.slice/crio-5edb067ae518800370edd9c29c4140ce35aa9bde92ff3a99911ab03743e802f9 WatchSource:0}: Error finding container 5edb067ae518800370edd9c29c4140ce35aa9bde92ff3a99911ab03743e802f9: Status 404 returned error can't find the container with id 5edb067ae518800370edd9c29c4140ce35aa9bde92ff3a99911ab03743e802f9 Jun 11 17:47:28.023899 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.023866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:28.024057 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.024007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:28.024057 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.024039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:28.024150 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024024 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:28.024150 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024113 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:28.024150 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024129 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:30.024108856 +0000 UTC m=+6.118202358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:28.024150 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024131 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:28.024150 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024145 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:28.024410 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024154 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:28.024410 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024195 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:30.024184167 +0000 UTC m=+6.118277666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:28.024410 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.024222 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:30.024205019 +0000 UTC m=+6.118298505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:28.356845 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.356807 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 17:42:26 +0000 UTC" deadline="2028-01-10 02:39:11.861607685 +0000 UTC" Jun 11 17:47:28.356845 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.356844 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13856h51m43.504768074s" Jun 11 17:47:28.372671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.372643 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:28.372801 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.372776 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:28.373201 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.373164 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:28.373311 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.373275 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:28.373372 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.373338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:28.373428 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:28.373409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:28.404191 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.403330 2574 generic.go:356] "Generic (PLEG): container finished" podID="9b4e615cdb5d351585ce56dbf7bd7878" containerID="d9a1292bd13461452c0b0d2428d7ebce78d31fa556701fc17cd829bcfb595345" exitCode=0 Jun 11 17:47:28.404191 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.403951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" event={"ID":"9b4e615cdb5d351585ce56dbf7bd7878","Type":"ContainerDied","Data":"d9a1292bd13461452c0b0d2428d7ebce78d31fa556701fc17cd829bcfb595345"} Jun 11 17:47:28.409287 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.409237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" event={"ID":"f61b3a1b-1c41-440b-8e32-126482a2a2cc","Type":"ContainerStarted","Data":"9b6373aed3c35762eb0fc77f5995b3695e612323adb4d4f19f650562a857a198"} Jun 11 17:47:28.415726 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.414005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzfs9" event={"ID":"8966178f-9c53-4d4c-ab20-4fc630de5e8f","Type":"ContainerStarted","Data":"5558a5be69b3417cf15a90c5f3093fd4280bd6a0c954f767b75b118ae98e5ab0"} Jun 11 17:47:28.430208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.430184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerStarted","Data":"5edb067ae518800370edd9c29c4140ce35aa9bde92ff3a99911ab03743e802f9"} Jun 11 17:47:28.440012 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.439913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"2f35fef1e4ec1d7edbaa91caac93c49b834b42d39458071e6a2b59fee1850a65"} Jun 11 17:47:28.448308 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.448284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rb8j9" event={"ID":"d47c06f4-a40c-4ac8-8181-d58333183ad1","Type":"ContainerStarted","Data":"a81c0a2a0fd37aed491717375e0d223549bfca8e2cc1df84c95bc1dcf27af7dd"} Jun 11 17:47:28.458794 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.458770 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" event={"ID":"ff656541-a58e-484e-b1a6-db93a0e6b7cd","Type":"ContainerStarted","Data":"2bfcd60c538d7b72bb559c93298ea131d3e19e6745a32b642bcebf58294d9372"} Jun 11 17:47:28.473001 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.472972 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mg76q" event={"ID":"53c40270-3cc5-4ebd-aca2-e6e9de611350","Type":"ContainerStarted","Data":"f9793b85ab576053cfabd3a0563d22833b00f5bd0def6a38b8957ef764c399a4"} Jun 11 17:47:28.493922 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.493892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" event={"ID":"df5acc5da7deed969d9d6b9c58d33ee0","Type":"ContainerStarted","Data":"77ef892916148162c3cd305d1d89f4b02dee51abd52d19c0691cd43ccc503ef0"} Jun 11 17:47:28.518697 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.518667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqjcd" event={"ID":"7e4fb0f4-66d7-44c1-960e-52d9f994435f","Type":"ContainerStarted","Data":"375fdce8608bf98dc826a643f3332e7401ae0fb39c86104ffe312e40bce543e3"} Jun 11 17:47:28.533113 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:28.533084 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8p7p" event={"ID":"99fa751d-c4b6-490b-aa65-cb8b85e02175","Type":"ContainerStarted","Data":"551e6ed054c26af87e775addf5402ac11a93f361104d08ab3f6ddef1e1360918"} Jun 11 17:47:29.554233 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:29.554196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" event={"ID":"9b4e615cdb5d351585ce56dbf7bd7878","Type":"ContainerStarted","Data":"094462b267639c29c3b8b92d5e3adc5c9c99c68d43fa136b7d0cc9916a33065f"} Jun 11 17:47:29.583145 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:29.582380 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-204.ec2.internal" podStartSLOduration=4.582360087 podStartE2EDuration="4.582360087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:28.515923552 +0000 UTC m=+4.610017060" watchObservedRunningTime="2026-06-11 17:47:29.582360087 +0000 UTC m=+5.676453595" Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.039581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.039639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.039681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.039821 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.039881 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:34.039864393 +0000 UTC m=+10.133957880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040364 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040387 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040400 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040447 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:34.040432067 +0000 UTC m=+10.134525554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040521 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:30.040638 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.040564 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:34.040551575 +0000 UTC m=+10.134645065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:30.369587 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.369507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:30.369749 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.369655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:30.369749 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.369725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:30.369885 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.369796 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:30.369885 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:30.369866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:30.369990 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:30.369942 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:32.370259 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:32.370226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:32.370259 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:32.370259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:32.370752 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:32.370380 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:32.370752 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:32.370413 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:32.370752 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:32.370546 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:32.370752 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:32.370626 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:34.072399 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.072357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:34.072399 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.072415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.072459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072530 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072554 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072566 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072613 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:42.072605983 +0000 UTC m=+18.166699480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072567 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:42.072635871 +0000 UTC m=+18.166729357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:34.072915 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.072669 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:42.072661158 +0000 UTC m=+18.166754642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.372919 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.372970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:34.372973 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.373249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.373331 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:34.373438 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:34.373410 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:36.375516 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:36.375227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:36.375516 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:36.375436 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:36.376001 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:36.375599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:36.376001 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:36.375949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:36.376093 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:36.375916 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:36.376093 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:36.376073 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:38.373150 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.373074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:38.373670 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.373193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:38.373670 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:38.373220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:38.373670 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:38.373295 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:38.373670 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.373344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:38.373670 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:38.373436 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:38.575234 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.575204 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqjcd" event={"ID":"7e4fb0f4-66d7-44c1-960e-52d9f994435f","Type":"ContainerStarted","Data":"7df8f753410f0261fd916d33ccde4ce6ab2d773777af03c63deb98d608cfa315"} Jun 11 17:47:38.592146 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.592096 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lqjcd" podStartSLOduration=4.071521424 podStartE2EDuration="14.59208337s" totalImagesPullingTime="10.520561946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:38.591820031 +0000 UTC m=+14.685913538" watchObservedRunningTime="2026-06-11 17:47:38.59208337 +0000 UTC m=+14.686176876" Jun 11 17:47:38.592334 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:38.592308 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-204.ec2.internal" podStartSLOduration=13.592300073 podStartE2EDuration="13.592300073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:29.583053556 +0000 UTC m=+5.677147063" watchObservedRunningTime="2026-06-11 17:47:38.592300073 +0000 UTC m=+14.686393577" Jun 11 17:47:39.085613 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:39.085528 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:39.579148 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:39.579109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzfs9" event={"ID":"8966178f-9c53-4d4c-ab20-4fc630de5e8f","Type":"ContainerStarted","Data":"60b9a4d01fb52aaf8fae323f4fda5c37b6b756bd666de8c820f73dd72f86ec3c"} Jun 11 17:47:40.370414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:40.370360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:40.370601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:40.370360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:40.370601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:40.370501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:40.370601 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:40.370503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:40.370601 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:40.370578 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:40.370880 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:40.370665 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:41.576495 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:41.576461 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:41.577036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:41.577014 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:41.582634 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:41.582609 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lqjcd" Jun 11 17:47:41.593729 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:41.593676 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzfs9" podStartSLOduration=7.079889784 podStartE2EDuration="17.593659112s" totalImagesPullingTime="10.513769328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:39.610800433 +0000 UTC m=+15.704893941" watchObservedRunningTime="2026-06-11 17:47:41.593659112 +0000 UTC m=+17.687752618" Jun 11 17:47:42.133220 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.133193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.133226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.133259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133347 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133358 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133374 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133390 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:42.133404 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133402 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:42.133712 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:58.133399223 +0000 UTC m=+34.227492707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:42.133712 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133437 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:58.133428109 +0000 UTC m=+34.227521592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:42.133712 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.133455 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:47:58.133444789 +0000 UTC m=+34.227538295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:42.369755 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.369671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:42.369755 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.369690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:42.369929 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:42.369670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:42.369929 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.369791 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:42.369929 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.369886 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:42.370048 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:42.370002 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:44.371348 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:44.371309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:44.371960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:44.371404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:44.371960 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:44.371421 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:44.371960 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:44.371504 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:44.371960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:44.371535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:44.371960 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:44.371610 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:46.370708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.370393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:46.371141 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:46.370738 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:46.371141 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.370818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:46.371141 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:46.370912 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:46.371141 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.371037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:46.371446 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:46.371143 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:46.592929 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.592730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mg76q" event={"ID":"53c40270-3cc5-4ebd-aca2-e6e9de611350","Type":"ContainerStarted","Data":"7acf68a7d8b75d4f5729cd60a4f364b1e40aa5987fbbef96714c0c6ae07d8b89"} Jun 11 17:47:46.594029 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.594004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8p7p" event={"ID":"99fa751d-c4b6-490b-aa65-cb8b85e02175","Type":"ContainerStarted","Data":"e863a0293d198bc8757c768c1d023b053c7fd00682853a2c723ffe7520e77189"} Jun 11 17:47:46.595397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.595372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" event={"ID":"f61b3a1b-1c41-440b-8e32-126482a2a2cc","Type":"ContainerStarted","Data":"b31fdc9077ccad87d31ec21f65410da93266f4b983acd5a87b008a1d01ebf7d4"} Jun 11 17:47:46.596796 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.596777 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="12de7b2cb2a5fee8ce40e4253ceac989897ee9444b74365aa5a876d7e1a2748c" exitCode=0 Jun 11 17:47:46.596889 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.596853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"12de7b2cb2a5fee8ce40e4253ceac989897ee9444b74365aa5a876d7e1a2748c"} Jun 11 17:47:46.599019 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.599001 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"3a8a8f9add03b3e17e14c85db0aa46b6e7074c806fd358fcd1bbabfe00beeffb"} Jun 11 17:47:46.599116 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.599063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"efc76fd843426df6c60664fd467734d6ea8d87ff161d4a732ad6426f81b93fcb"} Jun 11 17:47:46.599116 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.599095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"46eb8d992e071815aa68763c636ad754b0b7aaeed5e0a58ca600b2f31c1edcec"} Jun 11 17:47:46.600311 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.600289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rb8j9" event={"ID":"d47c06f4-a40c-4ac8-8181-d58333183ad1","Type":"ContainerStarted","Data":"eada250182fd2ddee307c8e2ed753e0a4c7b1edc21acf087bd64db41184279a2"} Jun 11 17:47:46.601627 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.601610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" event={"ID":"ff656541-a58e-484e-b1a6-db93a0e6b7cd","Type":"ContainerStarted","Data":"cbfe210f7e49de94990dd48e4e582c1d87bb36270a91bf47f782bcfdbb9eeaf7"} Jun 11 17:47:46.614194 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.614141 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mg76q" podStartSLOduration=4.015058472 podStartE2EDuration="22.614130127s" totalImagesPullingTime="18.599071655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:46.613962109 +0000 UTC m=+22.708055614" watchObservedRunningTime="2026-06-11 17:47:46.614130127 +0000 UTC m=+22.708223692" Jun 11 17:47:46.692587 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.692543 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jsh8x" podStartSLOduration=4.153519957 podStartE2EDuration="22.692527769s" totalImagesPullingTime="18.539007812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:46.659654205 +0000 UTC m=+22.753747711" watchObservedRunningTime="2026-06-11 17:47:46.692527769 +0000 UTC m=+22.786621276" Jun 11 17:47:46.692985 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.692949 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rb8j9" podStartSLOduration=12.142744554 podStartE2EDuration="22.692936123s" totalImagesPullingTime="10.550191569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:46.692667621 +0000 UTC m=+22.786761128" watchObservedRunningTime="2026-06-11 17:47:46.692936123 +0000 UTC m=+22.787029631" Jun 11 17:47:46.718211 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:46.718159 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f8p7p" podStartSLOduration=12.137720514 podStartE2EDuration="22.718149067s" totalImagesPullingTime="10.580428553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:46.717988565 +0000 UTC m=+22.812082075" watchObservedRunningTime="2026-06-11 17:47:46.718149067 +0000 UTC m=+22.812242574" Jun 11 17:47:47.607567 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:47.607533 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"2e0fdafa80fe081d63623bcef089081734b05623c6b54f0b858b0fa0add3edc6"} Jun 11 17:47:47.608231 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:47.607637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"79e42bf61e81593b569a84d73fa2b87613041c06f8893be33ed6d89ed0fa3c26"} Jun 11 17:47:47.608231 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:47.607690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"93f6057014a223a3d49c6e16b08b6be10122448cf6fb5c6c364f6a4886322b41"} Jun 11 17:47:47.710894 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:47.710864 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 17:47:48.370292 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.370167 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T17:47:47.710887217Z","UUID":"1dc122ff-3b0a-42a2-8428-487c452b4016","Handler":null,"Name":"","Endpoint":""} Jun 11 17:47:48.370497 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.370301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:48.370497 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.370338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:48.370497 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.370301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:48.370497 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:48.370413 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:48.370497 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:48.370488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:48.370780 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:48.370606 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:48.372391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.372369 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 17:47:48.372502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.372415 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 17:47:48.612684 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:48.612641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" event={"ID":"ff656541-a58e-484e-b1a6-db93a0e6b7cd","Type":"ContainerStarted","Data":"4873d86849bc8188fceedc85754a8e5287b24f5e3117567b7b85a73d6d46def3"} Jun 11 17:47:49.619392 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:49.619351 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"9317c784156afbfffcf38ada2ae8294412215373066ec8ac1281920505666266"} Jun 11 17:47:49.621632 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:49.621605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" event={"ID":"ff656541-a58e-484e-b1a6-db93a0e6b7cd","Type":"ContainerStarted","Data":"0ab107adf303486cdbd48c6c2fbcbe5f83c8701891f8e57f65f97c44718c677e"} Jun 11 17:47:49.645332 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:49.645279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9mxj" podStartSLOduration=12.463472535 podStartE2EDuration="25.645260869s" totalImagesPullingTime="13.181788334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:49.644275219 +0000 UTC m=+25.738368747" watchObservedRunningTime="2026-06-11 17:47:49.645260869 +0000 UTC m=+25.739354378" Jun 11 17:47:50.369740 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:50.369712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:50.369920 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:50.369810 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:50.369920 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:50.369722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:50.369920 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:50.369864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:50.370055 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:50.369974 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:50.370093 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:50.370071 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:52.369611 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.369571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:52.369611 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.369596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:52.369611 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.369607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:52.370212 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:52.369697 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:52.370212 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:52.369844 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:52.370212 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:52.369945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:52.632406 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.632135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" event={"ID":"b18b883f-be77-4fe5-892e-e599d3c0993e","Type":"ContainerStarted","Data":"21557908af766946af914666484df3f476c2cebcd129c5c58c2ae2280ef9f6fc"} Jun 11 17:47:52.632789 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.632625 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:52.647677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.647660 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:52.664701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:52.663048 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" podStartSLOduration=10.049062987 podStartE2EDuration="28.663030044s" totalImagesPullingTime="18.613967057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:47:52.662127257 +0000 UTC m=+28.756220758" watchObservedRunningTime="2026-06-11 17:47:52.663030044 +0000 UTC m=+28.757123552" Jun 11 17:47:53.636130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:53.636092 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="078710b2f7a9fa85b722e30a9123504c799af2a782c48e6305e39d2306645a0b" exitCode=0 Jun 11 17:47:53.636659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:53.636167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"078710b2f7a9fa85b722e30a9123504c799af2a782c48e6305e39d2306645a0b"} Jun 11 17:47:53.636659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:53.636354 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:53.636659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:53.636418 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:53.651577 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:53.651553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:47:54.371057 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.371023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:54.371235 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.371105 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:54.371235 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.371110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:54.371235 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.371206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:54.371235 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.371224 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:54.371453 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.371279 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:54.548209 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.548163 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6t52c"] Jun 11 17:47:54.551855 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.551833 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lw8x4"] Jun 11 17:47:54.552489 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.552465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4v2rl"] Jun 11 17:47:54.637869 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.637809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:54.638268 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.637809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:54.638268 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:54.637809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:54.638268 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.637909 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:54.638428 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.638267 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:54.638428 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:54.638336 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:55.643034 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:55.642733 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="b9b80b09c11b11948c1d03da95c254a3e7bd04b3788cb90e2700c6ad2279ee12" exitCode=0 Jun 11 17:47:55.643508 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:55.642809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"b9b80b09c11b11948c1d03da95c254a3e7bd04b3788cb90e2700c6ad2279ee12"} Jun 11 17:47:56.370355 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:56.370323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:56.370355 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:56.370343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:56.370579 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:56.370331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:56.370579 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:56.370446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:56.370579 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:56.370552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:56.370737 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:56.370618 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:56.650101 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:56.650069 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="49f2ba75e9bbf9bb5e5c3c7947d6d2ba61c7d992363a4308b12412f8deb6bbb6" exitCode=0 Jun 11 17:47:56.650653 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:56.650127 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"49f2ba75e9bbf9bb5e5c3c7947d6d2ba61c7d992363a4308b12412f8deb6bbb6"} Jun 11 17:47:58.156472 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.156401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:58.156472 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.156436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.156471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156558 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156569 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156595 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156607 2574 projected.go:196] Error preparing data for projected volume kube-api-access-kf2m6 for pod openshift-network-diagnostics/network-check-target-lw8x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156616 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:30.156601553 +0000 UTC m=+66.250695037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6 podName:0985a528-9810-4e5a-ab5a-3f8d861746d1 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:30.156634626 +0000 UTC m=+66.250728109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kf2m6" (UniqueName: "kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6") pod "network-check-target-lw8x4" (UID: "0985a528-9810-4e5a-ab5a-3f8d861746d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156569 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:58.156922 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.156697 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret podName:ebc27922-4bdf-41bc-9c57-f03234d46b89 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:30.156688867 +0000 UTC m=+66.250782353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret") pod "global-pull-secret-syncer-6t52c" (UID: "ebc27922-4bdf-41bc-9c57-f03234d46b89") : object "kube-system"/"original-pull-secret" not registered Jun 11 17:47:58.369915 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.369887 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:47:58.370099 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.370014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:47:58.370164 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.370009 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lw8x4" podUID="0985a528-9810-4e5a-ab5a-3f8d861746d1" Jun 11 17:47:58.370164 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.370134 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4v2rl" podUID="ee875c8a-b9c4-45e0-954d-bc0a5ae887b5" Jun 11 17:47:58.370164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:58.370147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:47:58.370325 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:58.370270 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6t52c" podUID="ebc27922-4bdf-41bc-9c57-f03234d46b89" Jun 11 17:47:59.701284 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.701255 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-204.ec2.internal" event="NodeReady" Jun 11 17:47:59.701673 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.701401 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 17:47:59.737522 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.737494 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:47:59.740796 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.740777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.743400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.743305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 17:47:59.743400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.743345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 17:47:59.743400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.743351 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 17:47:59.743616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.743411 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgbxm\"" Jun 11 17:47:59.751957 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.751935 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-92hvr"] Jun 11 17:47:59.753046 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.753024 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 17:47:59.755947 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.755931 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q528d"] Jun 11 17:47:59.756088 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.756071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.758913 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.758830 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 17:47:59.759019 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.758922 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 17:47:59.759286 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.759255 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fr87q\"" Jun 11 17:47:59.759467 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.759448 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.760513 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.760493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:47:59.761669 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.761651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 17:47:59.762341 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.762321 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 17:47:59.762451 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.762428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lmckq\"" Jun 11 17:47:59.762546 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.762531 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 17:47:59.766385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.766347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92hvr"] Jun 11 17:47:59.767035 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.767016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q528d"] Jun 11 17:47:59.870464 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27hh\" (UniqueName: \"kubernetes.io/projected/21f1ec37-dc61-44e8-aa58-b2552536b972-kube-api-access-p27hh\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.870608 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870608 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870608 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21f1ec37-dc61-44e8-aa58-b2552536b972-tmp-dir\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.870608 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gjfk\" (UniqueName: \"kubernetes.io/projected/901a14ba-c704-48a1-8bb1-03444eda270e-kube-api-access-7gjfk\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.870608 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870765 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870765 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/901a14ba-c704-48a1-8bb1-03444eda270e-cert\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.870765 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snh2\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870765 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870765 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.870909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.870909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.870872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21f1ec37-dc61-44e8-aa58-b2552536b972-config-volume\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.971844 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21f1ec37-dc61-44e8-aa58-b2552536b972-config-volume\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27hh\" (UniqueName: \"kubernetes.io/projected/21f1ec37-dc61-44e8-aa58-b2552536b972-kube-api-access-p27hh\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.971957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21f1ec37-dc61-44e8-aa58-b2552536b972-tmp-dir\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gjfk\" (UniqueName: \"kubernetes.io/projected/901a14ba-c704-48a1-8bb1-03444eda270e-kube-api-access-7gjfk\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:59.972080 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:59.972133 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:00.472116573 +0000 UTC m=+36.566210075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/901a14ba-c704-48a1-8bb1-03444eda270e-cert\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snh2\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972306 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972710 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21f1ec37-dc61-44e8-aa58-b2552536b972-tmp-dir\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972710 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:59.972431 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:47:59.972710 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:59.972446 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:47:59.972710 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:47:59.972494 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:00.47247578 +0000 UTC m=+36.566569279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:47:59.972710 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972670 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21f1ec37-dc61-44e8-aa58-b2552536b972-config-volume\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.972907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.972962 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.972944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.973508 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.973482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.976027 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.976010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.976092 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.976011 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.976135 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.976119 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/901a14ba-c704-48a1-8bb1-03444eda270e-cert\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.981226 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.981164 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27hh\" (UniqueName: \"kubernetes.io/projected/21f1ec37-dc61-44e8-aa58-b2552536b972-kube-api-access-p27hh\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:47:59.981451 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.981430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gjfk\" (UniqueName: \"kubernetes.io/projected/901a14ba-c704-48a1-8bb1-03444eda270e-kube-api-access-7gjfk\") pod \"ingress-canary-q528d\" (UID: \"901a14ba-c704-48a1-8bb1-03444eda270e\") " pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:47:59.981534 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.981475 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:47:59.981612 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:47:59.981593 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snh2\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:00.074667 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.074638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q528d" Jun 11 17:48:00.245004 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.244812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q528d"] Jun 11 17:48:00.247625 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:00.247597 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901a14ba_c704_48a1_8bb1_03444eda270e.slice/crio-c473c3c8fd80c28db27b5bb9f4580a6ba0d26ad12463b55b2bbcbcbe4d4395bd WatchSource:0}: Error finding container c473c3c8fd80c28db27b5bb9f4580a6ba0d26ad12463b55b2bbcbcbe4d4395bd: Status 404 returned error can't find the container with id c473c3c8fd80c28db27b5bb9f4580a6ba0d26ad12463b55b2bbcbcbe4d4395bd Jun 11 17:48:00.370366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.370335 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:48:00.370512 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.370335 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:48:00.370581 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.370341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:48:00.373593 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.373571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 17:48:00.373720 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.373602 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 17:48:00.373720 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.373622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 17:48:00.373920 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.373904 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jffb6\"" Jun 11 17:48:00.374786 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.374767 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 17:48:00.374895 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.374769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t75m7\"" Jun 11 17:48:00.476146 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.476114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:00.476270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.476165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:00.476329 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:00.476274 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:00.476329 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:00.476289 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:00.476431 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:00.476341 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:01.476327186 +0000 UTC m=+37.570420669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:00.476431 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:00.476351 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:00.476431 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:00.476406 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:01.476389773 +0000 UTC m=+37.570483276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:00.661577 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.661504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q528d" event={"ID":"901a14ba-c704-48a1-8bb1-03444eda270e","Type":"ContainerStarted","Data":"c473c3c8fd80c28db27b5bb9f4580a6ba0d26ad12463b55b2bbcbcbe4d4395bd"} Jun 11 17:48:00.724871 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.724839 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:00.835199 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.835104 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:00.933265 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:00.933160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:01.033643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:01.033612 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:01.099038 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:01.098974 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:01.484008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:01.483967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:01.484008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:01.484012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:01.484379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:01.484150 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:01.484379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:01.484188 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:01.484379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:01.484204 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:01.484379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:01.484258 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:03.484236879 +0000 UTC m=+39.578330406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:01.484379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:01.484279 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:03.484270174 +0000 UTC m=+39.578363657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:03.500775 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:03.500739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:03.500780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:03.500893 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:03.500914 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:03.500960 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:03.500968 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:07.50095381 +0000 UTC m=+43.595047294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:03.501261 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:03.501010 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:07.500993261 +0000 UTC m=+43.595086768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:03.838310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:03.838281 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:03.940732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:03.940698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:04.667618 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.667580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:04.671236 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.671209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q528d" event={"ID":"901a14ba-c704-48a1-8bb1-03444eda270e","Type":"ContainerStarted","Data":"38ad1a653da44cb0b4e2a302db14b050f051a885e831c69a6fc1c56395dcabb0"} Jun 11 17:48:04.673815 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.673791 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="f8a84958737703242755e03078785d0ec5cc6c5bcab982ed59288d7dbdabf74f" exitCode=0 Jun 11 17:48:04.673911 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.673836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"f8a84958737703242755e03078785d0ec5cc6c5bcab982ed59288d7dbdabf74f"} Jun 11 17:48:04.689927 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.689883 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q528d" podStartSLOduration=2.216833759 podStartE2EDuration="5.689871113s" totalImagesPullingTime="3.473037354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:04.689566144 +0000 UTC m=+40.783659650" watchObservedRunningTime="2026-06-11 17:48:04.689871113 +0000 UTC m=+40.783964620" Jun 11 17:48:04.737588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:04.737560 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:05.678843 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:05.678813 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6581553-8e92-48e5-9ad6-d80f6da12f7b" containerID="6fa3b354caf618732085e1d3c09c1f0085f1811f87c7154ca7e4074aead5a647" exitCode=0 Jun 11 17:48:05.679329 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:05.678903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerDied","Data":"6fa3b354caf618732085e1d3c09c1f0085f1811f87c7154ca7e4074aead5a647"} Jun 11 17:48:06.684667 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:06.684634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" event={"ID":"a6581553-8e92-48e5-9ad6-d80f6da12f7b","Type":"ContainerStarted","Data":"1ed543acdfebf10ad947d0a0cc3e09660f6ecd29748aea62282723bc31e02948"} Jun 11 17:48:06.712418 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:06.712372 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9lfcn" podStartSLOduration=17.04869078 podStartE2EDuration="42.712357447s" totalImagesPullingTime="25.663666667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:06.710245081 +0000 UTC m=+42.804338605" watchObservedRunningTime="2026-06-11 17:48:06.712357447 +0000 UTC m=+42.806450953" Jun 11 17:48:06.846533 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:06.846504 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:06.918210 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:06.918165 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:07.531097 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:07.531060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:07.531097 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:07.531098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:07.531313 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:07.531219 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:07.531313 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:07.531223 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:07.531313 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:07.531242 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:07.531313 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:07.531271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:15.531257248 +0000 UTC m=+51.625350732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:07.531313 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:07.531284 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:15.531278222 +0000 UTC m=+51.625371706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:15.585687 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:15.585649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:15.585733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:15.585798 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:15.585812 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:15.585822 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:15.585866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:31.585853824 +0000 UTC m=+67.679947308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:15.586254 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:15.585879 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:31.585873285 +0000 UTC m=+67.679966770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:17.915267 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:17.915224 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:17.986019 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:17.985989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:18.040151 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:18.040126 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:18.914316 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:18.914270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:18.969436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:18.969404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:21.864091 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:21.863875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" limit=1024 Jun 11 17:48:25.663264 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:25.663203 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frlrn" Jun 11 17:48:30.183550 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.183512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:48:30.183550 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.183552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:48:30.183947 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.183582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:48:30.186070 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.186047 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 17:48:30.186208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.186114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 17:48:30.186208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.186114 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 17:48:30.194406 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:30.194389 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 17:48:30.194488 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:30.194465 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs podName:ee875c8a-b9c4-45e0-954d-bc0a5ae887b5 nodeName:}" failed. No retries permitted until 2026-06-11 17:49:34.194446313 +0000 UTC m=+130.288539815 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs") pod "network-metrics-daemon-4v2rl" (UID: "ee875c8a-b9c4-45e0-954d-bc0a5ae887b5") : secret "metrics-daemon-secret" not found Jun 11 17:48:30.196680 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.196664 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 17:48:30.197593 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.197575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc27922-4bdf-41bc-9c57-f03234d46b89-original-pull-secret\") pod \"global-pull-secret-syncer-6t52c\" (UID: \"ebc27922-4bdf-41bc-9c57-f03234d46b89\") " pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:48:30.206787 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.206766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2m6\" (UniqueName: \"kubernetes.io/projected/0985a528-9810-4e5a-ab5a-3f8d861746d1-kube-api-access-kf2m6\") pod \"network-check-target-lw8x4\" (UID: \"0985a528-9810-4e5a-ab5a-3f8d861746d1\") " pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:48:30.382628 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.382597 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t75m7\"" Jun 11 17:48:30.385742 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.385720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6t52c" Jun 11 17:48:30.391144 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.391126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:48:30.510996 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.510926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6t52c"] Jun 11 17:48:30.514787 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:30.514760 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc27922_4bdf_41bc_9c57_f03234d46b89.slice/crio-7588eeb4cb04798251fc4b99273044ff241bd7314a4e20ab53bdcd2ca40f9f3a WatchSource:0}: Error finding container 7588eeb4cb04798251fc4b99273044ff241bd7314a4e20ab53bdcd2ca40f9f3a: Status 404 returned error can't find the container with id 7588eeb4cb04798251fc4b99273044ff241bd7314a4e20ab53bdcd2ca40f9f3a Jun 11 17:48:30.522573 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.522546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lw8x4"] Jun 11 17:48:30.524972 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:30.524952 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0985a528_9810_4e5a_ab5a_3f8d861746d1.slice/crio-0bdefa56274aaf30627bdfe756267080634008ed592c577395a52850a7f530ad WatchSource:0}: Error finding container 0bdefa56274aaf30627bdfe756267080634008ed592c577395a52850a7f530ad: Status 404 returned error can't find the container with id 0bdefa56274aaf30627bdfe756267080634008ed592c577395a52850a7f530ad Jun 11 17:48:30.738788 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.738707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lw8x4" event={"ID":"0985a528-9810-4e5a-ab5a-3f8d861746d1","Type":"ContainerStarted","Data":"0bdefa56274aaf30627bdfe756267080634008ed592c577395a52850a7f530ad"} Jun 11 17:48:30.739667 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:30.739646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6t52c" event={"ID":"ebc27922-4bdf-41bc-9c57-f03234d46b89","Type":"ContainerStarted","Data":"7588eeb4cb04798251fc4b99273044ff241bd7314a4e20ab53bdcd2ca40f9f3a"} Jun 11 17:48:31.593319 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:31.593268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:48:31.593759 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:31.593391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:48:31.593759 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:31.593517 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 17:48:31.593759 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:31.593567 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685c76c4d-bwm5q: secret "image-registry-tls" not found Jun 11 17:48:31.593759 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:31.593606 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 17:48:31.593759 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:31.593699 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls podName:777822ae-a10c-4b1a-9adc-d030f03b0360 nodeName:}" failed. No retries permitted until 2026-06-11 17:49:03.593637196 +0000 UTC m=+99.687730700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls") pod "image-registry-685c76c4d-bwm5q" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360") : secret "image-registry-tls" not found Jun 11 17:48:31.594051 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:31.593786 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls podName:21f1ec37-dc61-44e8-aa58-b2552536b972 nodeName:}" failed. No retries permitted until 2026-06-11 17:49:03.593711299 +0000 UTC m=+99.687804795 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls") pod "dns-default-92hvr" (UID: "21f1ec37-dc61-44e8-aa58-b2552536b972") : secret "dns-default-metrics-tls" not found Jun 11 17:48:35.031123 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.031088 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn"] Jun 11 17:48:35.033044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.033018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" Jun 11 17:48:35.035448 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.035425 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xwj5r\"" Jun 11 17:48:35.037508 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.037447 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-m6w9m"] Jun 11 17:48:35.039471 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.039453 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.042238 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.042015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6tkhs\"" Jun 11 17:48:35.042238 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.042036 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 17:48:35.042238 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.042063 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 17:48:35.042238 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.042098 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:48:35.042238 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.042149 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 17:48:35.045559 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.045491 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn"] Jun 11 17:48:35.054358 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.052129 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-m6w9m"] Jun 11 17:48:35.055051 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.054963 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 17:48:35.121725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.121686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-config\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.121725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.121730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrwm\" (UniqueName: \"kubernetes.io/projected/2664630f-df16-4df1-9904-ff4a5ca3ead0-kube-api-access-qhrwm\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.121960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.121750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6pk7\" (UniqueName: \"kubernetes.io/projected/ebe1400d-3111-474e-8bc3-088a89fc014c-kube-api-access-r6pk7\") pod \"network-check-source-6947749cfc-pwvhn\" (UID: \"ebe1400d-3111-474e-8bc3-088a89fc014c\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" Jun 11 17:48:35.121960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.121774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2664630f-df16-4df1-9904-ff4a5ca3ead0-serving-cert\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.121960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.121878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-trusted-ca\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.222414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.222371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-config\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.222598 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.222432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrwm\" (UniqueName: \"kubernetes.io/projected/2664630f-df16-4df1-9904-ff4a5ca3ead0-kube-api-access-qhrwm\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.222598 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.222469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6pk7\" (UniqueName: \"kubernetes.io/projected/ebe1400d-3111-474e-8bc3-088a89fc014c-kube-api-access-r6pk7\") pod \"network-check-source-6947749cfc-pwvhn\" (UID: \"ebe1400d-3111-474e-8bc3-088a89fc014c\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" Jun 11 17:48:35.222598 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.222495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2664630f-df16-4df1-9904-ff4a5ca3ead0-serving-cert\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.222598 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.222572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-trusted-ca\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.223221 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.223193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-config\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.223510 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.223482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2664630f-df16-4df1-9904-ff4a5ca3ead0-trusted-ca\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.225287 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.225265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2664630f-df16-4df1-9904-ff4a5ca3ead0-serving-cert\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.233164 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.233143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrwm\" (UniqueName: \"kubernetes.io/projected/2664630f-df16-4df1-9904-ff4a5ca3ead0-kube-api-access-qhrwm\") pod \"console-operator-5dbbb5d744-m6w9m\" (UID: \"2664630f-df16-4df1-9904-ff4a5ca3ead0\") " pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.233270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.233193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6pk7\" (UniqueName: \"kubernetes.io/projected/ebe1400d-3111-474e-8bc3-088a89fc014c-kube-api-access-r6pk7\") pod \"network-check-source-6947749cfc-pwvhn\" (UID: \"ebe1400d-3111-474e-8bc3-088a89fc014c\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" Jun 11 17:48:35.344764 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.344664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" Jun 11 17:48:35.356457 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.356432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:35.949272 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.949246 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-m6w9m"] Jun 11 17:48:35.951804 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:35.951778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2664630f_df16_4df1_9904_ff4a5ca3ead0.slice/crio-b7078eea0bd6273004aedea0eb7f395f7fed20af3d3c0f550ecbe82785de40ce WatchSource:0}: Error finding container b7078eea0bd6273004aedea0eb7f395f7fed20af3d3c0f550ecbe82785de40ce: Status 404 returned error can't find the container with id b7078eea0bd6273004aedea0eb7f395f7fed20af3d3c0f550ecbe82785de40ce Jun 11 17:48:35.966080 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:35.965999 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn"] Jun 11 17:48:35.969860 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:35.969837 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe1400d_3111_474e_8bc3_088a89fc014c.slice/crio-b013983014a6e502f7418e23cfb5ed617c1df2d0d27d17eb9c94ed04bfdf4175 WatchSource:0}: Error finding container b013983014a6e502f7418e23cfb5ed617c1df2d0d27d17eb9c94ed04bfdf4175: Status 404 returned error can't find the container with id b013983014a6e502f7418e23cfb5ed617c1df2d0d27d17eb9c94ed04bfdf4175 Jun 11 17:48:36.756690 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.756654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6t52c" event={"ID":"ebc27922-4bdf-41bc-9c57-f03234d46b89","Type":"ContainerStarted","Data":"26344ae42ec5ffb33f26dc5057b1144e8a02f3f2334477b44080e76bb717ba0c"} Jun 11 17:48:36.758351 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.758321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" event={"ID":"ebe1400d-3111-474e-8bc3-088a89fc014c","Type":"ContainerStarted","Data":"2883ca1fb5574d532bd9082153d5108f61b7d7521b87fa2e7ac3f36f74acec70"} Jun 11 17:48:36.758554 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.758373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" event={"ID":"ebe1400d-3111-474e-8bc3-088a89fc014c","Type":"ContainerStarted","Data":"b013983014a6e502f7418e23cfb5ed617c1df2d0d27d17eb9c94ed04bfdf4175"} Jun 11 17:48:36.759814 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.759764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" event={"ID":"2664630f-df16-4df1-9904-ff4a5ca3ead0","Type":"ContainerStarted","Data":"b7078eea0bd6273004aedea0eb7f395f7fed20af3d3c0f550ecbe82785de40ce"} Jun 11 17:48:36.761370 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.761236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lw8x4" event={"ID":"0985a528-9810-4e5a-ab5a-3f8d861746d1","Type":"ContainerStarted","Data":"5846191e07909c71f098eaea9d0ba314018219e8f4c90c914c7d4720cc286d2f"} Jun 11 17:48:36.761466 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.761398 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:48:36.774823 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.774778 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6t52c" podStartSLOduration=67.46567545 podStartE2EDuration="1m12.774747166s" totalImagesPullingTime="5.309071716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:36.774414284 +0000 UTC m=+72.868507805" watchObservedRunningTime="2026-06-11 17:48:36.774747166 +0000 UTC m=+72.868840672" Jun 11 17:48:36.790584 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.790546 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lw8x4" podStartSLOduration=67.503232029 podStartE2EDuration="1m12.790533535s" totalImagesPullingTime="5.287301506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:36.789923251 +0000 UTC m=+72.884016757" watchObservedRunningTime="2026-06-11 17:48:36.790533535 +0000 UTC m=+72.884627019" Jun 11 17:48:36.805809 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:36.805766 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-pwvhn" podStartSLOduration=1.805749184 podStartE2EDuration="1.805749184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:36.805117991 +0000 UTC m=+72.899211499" watchObservedRunningTime="2026-06-11 17:48:36.805749184 +0000 UTC m=+72.899842692" Jun 11 17:48:38.768146 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:38.768118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/0.log" Jun 11 17:48:38.768631 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:38.768157 2574 generic.go:356] "Generic (PLEG): container finished" podID="2664630f-df16-4df1-9904-ff4a5ca3ead0" containerID="9015bbaa7d7e154db960211a2057df76abc917c236eb235b245adcc779fd568e" exitCode=255 Jun 11 17:48:38.768631 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:38.768231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" event={"ID":"2664630f-df16-4df1-9904-ff4a5ca3ead0","Type":"ContainerDied","Data":"9015bbaa7d7e154db960211a2057df76abc917c236eb235b245adcc779fd568e"} Jun 11 17:48:38.768631 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:38.768469 2574 scope.go:117] "RemoveContainer" containerID="9015bbaa7d7e154db960211a2057df76abc917c236eb235b245adcc779fd568e" Jun 11 17:48:39.615873 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.615841 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cthtb"] Jun 11 17:48:39.618657 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.618631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.626959 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.626940 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 17:48:39.628231 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.628215 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 17:48:39.628471 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.628457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 17:48:39.630369 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.630353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bhzds\"" Jun 11 17:48:39.630633 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.630620 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 17:48:39.652993 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.652969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cthtb"] Jun 11 17:48:39.658502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.658483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.658582 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.658522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/582534e8-13b3-4d5d-812e-eb3ebd52a66b-crio-socket\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.658582 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.658555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/582534e8-13b3-4d5d-812e-eb3ebd52a66b-data-volume\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.658582 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.658577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcddm\" (UniqueName: \"kubernetes.io/projected/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-api-access-lcddm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.658689 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.658610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759204 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/582534e8-13b3-4d5d-812e-eb3ebd52a66b-crio-socket\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/582534e8-13b3-4d5d-812e-eb3ebd52a66b-data-volume\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcddm\" (UniqueName: \"kubernetes.io/projected/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-api-access-lcddm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/582534e8-13b3-4d5d-812e-eb3ebd52a66b-crio-socket\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.759634 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:39.759402 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 17:48:39.759634 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:39.759453 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:40.259439321 +0000 UTC m=+76.353532805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : secret "insights-runtime-extractor-tls" not found Jun 11 17:48:39.759634 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:39.759450 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 17:48:39.759634 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:39.759519 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:40.259500768 +0000 UTC m=+76.353594273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : configmap "kube-rbac-proxy" not found Jun 11 17:48:39.759634 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.759579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/582534e8-13b3-4d5d-812e-eb3ebd52a66b-data-volume\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.767703 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.767674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcddm\" (UniqueName: \"kubernetes.io/projected/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-api-access-lcddm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:39.774571 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.774553 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:48:39.774959 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.774941 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/0.log" Jun 11 17:48:39.775025 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.774983 2574 generic.go:356] "Generic (PLEG): container finished" podID="2664630f-df16-4df1-9904-ff4a5ca3ead0" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" exitCode=255 Jun 11 17:48:39.775065 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.775018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" event={"ID":"2664630f-df16-4df1-9904-ff4a5ca3ead0","Type":"ContainerDied","Data":"0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a"} Jun 11 17:48:39.775098 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.775082 2574 scope.go:117] "RemoveContainer" containerID="9015bbaa7d7e154db960211a2057df76abc917c236eb235b245adcc779fd568e" Jun 11 17:48:39.775258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.775240 2574 scope.go:117] "RemoveContainer" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" Jun 11 17:48:39.775426 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:39.775404 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-m6w9m_openshift-console-operator(2664630f-df16-4df1-9904-ff4a5ca3ead0)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" podUID="2664630f-df16-4df1-9904-ff4a5ca3ead0" Jun 11 17:48:39.976557 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.976517 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gj8qc"] Jun 11 17:48:39.980567 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.980545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:39.983153 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.983135 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 17:48:39.983270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.983227 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tq98q\"" Jun 11 17:48:39.983270 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.983229 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 17:48:39.989380 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:39.989360 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gj8qc"] Jun 11 17:48:40.061760 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.061731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bf0a3fa-218e-4379-aafc-169e54cfe303-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.061874 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.061768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.163130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.163102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bf0a3fa-218e-4379-aafc-169e54cfe303-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.163130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.163130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.163298 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.163272 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 17:48:40.163347 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.163338 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert podName:5bf0a3fa-218e-4379-aafc-169e54cfe303 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:40.663322359 +0000 UTC m=+76.757415867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gj8qc" (UID: "5bf0a3fa-218e-4379-aafc-169e54cfe303") : secret "networking-console-plugin-cert" not found Jun 11 17:48:40.163719 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.163704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bf0a3fa-218e-4379-aafc-169e54cfe303-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.263786 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.263710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:40.263786 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.263760 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:40.263949 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.263851 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 17:48:40.263949 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.263873 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 17:48:40.263949 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.263909 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:41.263891448 +0000 UTC m=+77.357984946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : secret "insights-runtime-extractor-tls" not found Jun 11 17:48:40.263949 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.263926 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:41.26391839 +0000 UTC m=+77.358011874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : configmap "kube-rbac-proxy" not found Jun 11 17:48:40.666081 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.665981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:40.666249 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.666153 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 17:48:40.666249 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.666242 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert podName:5bf0a3fa-218e-4379-aafc-169e54cfe303 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:41.666225553 +0000 UTC m=+77.760319037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gj8qc" (UID: "5bf0a3fa-218e-4379-aafc-169e54cfe303") : secret "networking-console-plugin-cert" not found Jun 11 17:48:40.778498 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.778466 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:48:40.778852 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:40.778800 2574 scope.go:117] "RemoveContainer" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" Jun 11 17:48:40.778957 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:40.778938 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-m6w9m_openshift-console-operator(2664630f-df16-4df1-9904-ff4a5ca3ead0)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" podUID="2664630f-df16-4df1-9904-ff4a5ca3ead0" Jun 11 17:48:41.272325 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:41.272287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:41.272562 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:41.272341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:41.272562 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.272417 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 17:48:41.272562 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.272441 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 17:48:41.272562 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.272486 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:43.272467974 +0000 UTC m=+79.366561461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : configmap "kube-rbac-proxy" not found Jun 11 17:48:41.272562 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.272550 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:43.272540069 +0000 UTC m=+79.366633554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : secret "insights-runtime-extractor-tls" not found Jun 11 17:48:41.539978 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:41.539903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8p7p_99fa751d-c4b6-490b-aa65-cb8b85e02175/dns-node-resolver/0.log" Jun 11 17:48:41.675781 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:41.675753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:41.675943 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.675891 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 17:48:41.675997 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:41.675953 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert podName:5bf0a3fa-218e-4379-aafc-169e54cfe303 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:43.675938064 +0000 UTC m=+79.770031548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gj8qc" (UID: "5bf0a3fa-218e-4379-aafc-169e54cfe303") : secret "networking-console-plugin-cert" not found Jun 11 17:48:42.741190 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:42.741144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rb8j9_d47c06f4-a40c-4ac8-8181-d58333183ad1/node-ca/0.log" Jun 11 17:48:43.289506 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:43.289471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:43.289677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:43.289514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:43.289677 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.289613 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 17:48:43.289677 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.289628 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 17:48:43.289677 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.289663 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:47.289650251 +0000 UTC m=+83.383743735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : configmap "kube-rbac-proxy" not found Jun 11 17:48:43.289824 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.289683 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:47.289672189 +0000 UTC m=+83.383765678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : secret "insights-runtime-extractor-tls" not found Jun 11 17:48:43.339436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:43.339418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q528d_901a14ba-c704-48a1-8bb1-03444eda270e/serve-healthcheck-canary/0.log" Jun 11 17:48:43.692071 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:43.692046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:43.692226 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.692163 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 17:48:43.692275 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:43.692234 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert podName:5bf0a3fa-218e-4379-aafc-169e54cfe303 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:47.692221074 +0000 UTC m=+83.786314558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gj8qc" (UID: "5bf0a3fa-218e-4379-aafc-169e54cfe303") : secret "networking-console-plugin-cert" not found Jun 11 17:48:45.357279 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:45.357241 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:45.357662 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:45.357336 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:45.357704 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:45.357683 2574 scope.go:117] "RemoveContainer" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" Jun 11 17:48:45.357856 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:45.357835 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-m6w9m_openshift-console-operator(2664630f-df16-4df1-9904-ff4a5ca3ead0)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" podUID="2664630f-df16-4df1-9904-ff4a5ca3ead0" Jun 11 17:48:45.791597 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:45.791570 2574 scope.go:117] "RemoveContainer" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" Jun 11 17:48:45.791766 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:45.791721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-m6w9m_openshift-console-operator(2664630f-df16-4df1-9904-ff4a5ca3ead0)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" podUID="2664630f-df16-4df1-9904-ff4a5ca3ead0" Jun 11 17:48:47.322808 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:47.322775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:47.323218 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:47.322862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:47.323218 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.322892 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 17:48:47.323218 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.322946 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 17:48:47.323218 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.322956 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:55.322942131 +0000 UTC m=+91.417035615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : configmap "kube-rbac-proxy" not found Jun 11 17:48:47.323218 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.322983 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls podName:582534e8-13b3-4d5d-812e-eb3ebd52a66b nodeName:}" failed. No retries permitted until 2026-06-11 17:48:55.32297278 +0000 UTC m=+91.417066264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cthtb" (UID: "582534e8-13b3-4d5d-812e-eb3ebd52a66b") : secret "insights-runtime-extractor-tls" not found Jun 11 17:48:47.725508 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:47.725480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:47.725729 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.725623 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 17:48:47.725729 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:48:47.725685 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert podName:5bf0a3fa-218e-4379-aafc-169e54cfe303 nodeName:}" failed. No retries permitted until 2026-06-11 17:48:55.725670882 +0000 UTC m=+91.819764367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gj8qc" (UID: "5bf0a3fa-218e-4379-aafc-169e54cfe303") : secret "networking-console-plugin-cert" not found Jun 11 17:48:55.383191 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.383139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:55.383715 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.383297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:55.383775 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.383756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/582534e8-13b3-4d5d-812e-eb3ebd52a66b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:55.385545 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.385518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/582534e8-13b3-4d5d-812e-eb3ebd52a66b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cthtb\" (UID: \"582534e8-13b3-4d5d-812e-eb3ebd52a66b\") " pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:55.527505 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.527481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cthtb" Jun 11 17:48:55.652280 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.652194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cthtb"] Jun 11 17:48:55.655921 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:55.655892 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582534e8_13b3_4d5d_812e_eb3ebd52a66b.slice/crio-e62c2474a1962b57425cfb4877a7bef7994d418453e276105188e8636a95247a WatchSource:0}: Error finding container e62c2474a1962b57425cfb4877a7bef7994d418453e276105188e8636a95247a: Status 404 returned error can't find the container with id e62c2474a1962b57425cfb4877a7bef7994d418453e276105188e8636a95247a Jun 11 17:48:55.786450 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.786421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:55.788767 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.788741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bf0a3fa-218e-4379-aafc-169e54cfe303-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gj8qc\" (UID: \"5bf0a3fa-218e-4379-aafc-169e54cfe303\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:55.816378 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.816350 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cthtb" event={"ID":"582534e8-13b3-4d5d-812e-eb3ebd52a66b","Type":"ContainerStarted","Data":"e62c2474a1962b57425cfb4877a7bef7994d418453e276105188e8636a95247a"} Jun 11 17:48:55.889232 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:55.889210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" Jun 11 17:48:56.015736 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:56.015699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gj8qc"] Jun 11 17:48:56.026042 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:48:56.026016 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf0a3fa_218e_4379_aafc_169e54cfe303.slice/crio-87b02c45bb4aec8c52ccf24fed4fce869dc1a7caf3f9279f38c7b5c4b5df9d68 WatchSource:0}: Error finding container 87b02c45bb4aec8c52ccf24fed4fce869dc1a7caf3f9279f38c7b5c4b5df9d68: Status 404 returned error can't find the container with id 87b02c45bb4aec8c52ccf24fed4fce869dc1a7caf3f9279f38c7b5c4b5df9d68 Jun 11 17:48:56.820359 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:56.820296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" event={"ID":"5bf0a3fa-218e-4379-aafc-169e54cfe303","Type":"ContainerStarted","Data":"87b02c45bb4aec8c52ccf24fed4fce869dc1a7caf3f9279f38c7b5c4b5df9d68"} Jun 11 17:48:57.825532 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:57.825491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" event={"ID":"5bf0a3fa-218e-4379-aafc-169e54cfe303","Type":"ContainerStarted","Data":"724bd3ee5f1847279c0f0d846b345fb5789af79cfbe1acc8b1775dc0f4513c7e"} Jun 11 17:48:57.841298 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:57.841236 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-gj8qc" podStartSLOduration=17.521203864 podStartE2EDuration="18.841221173s" totalImagesPullingTime="1.320017309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:57.839959894 +0000 UTC m=+93.934053400" watchObservedRunningTime="2026-06-11 17:48:57.841221173 +0000 UTC m=+93.935314713" Jun 11 17:48:59.370654 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.370621 2574 scope.go:117] "RemoveContainer" containerID="0044f67dd7930807ff15b8d58aa8f934f7d5663ee9f8fec86dc9affc0f884b7a" Jun 11 17:48:59.837681 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.837652 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:48:59.837852 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.837745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" event={"ID":"2664630f-df16-4df1-9904-ff4a5ca3ead0","Type":"ContainerStarted","Data":"06651ae6295d324b3b711e9c8ee838e55b88494a11fa6f9aac4acfe23047d5ee"} Jun 11 17:48:59.838273 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.838105 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:59.843229 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.839865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cthtb" event={"ID":"582534e8-13b3-4d5d-812e-eb3ebd52a66b","Type":"ContainerStarted","Data":"524bfef4961b9dd98bc2679b64c397fe032949307b71babe0afc6588d2236242"} Jun 11 17:48:59.844529 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.844508 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" Jun 11 17:48:59.854508 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:48:59.854469 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-m6w9m" podStartSLOduration=22.663253062 podStartE2EDuration="24.854457727s" totalImagesPullingTime="2.191204665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:48:59.853297599 +0000 UTC m=+95.947391106" watchObservedRunningTime="2026-06-11 17:48:59.854457727 +0000 UTC m=+95.948551233" Jun 11 17:49:00.758042 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.758012 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2"] Jun 11 17:49:00.761135 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.761117 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.763817 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.763794 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 17:49:00.763938 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.763864 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 17:49:00.764801 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.764784 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 17:49:00.764865 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.764833 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 17:49:00.786673 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.786642 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2"] Jun 11 17:49:00.828948 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.828914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623bb1bb-ae87-465f-8efd-7439652ee175-tmp\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.829110 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.828967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/623bb1bb-ae87-465f-8efd-7439652ee175-klusterlet-config\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.829110 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.829067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj9g5\" (UniqueName: \"kubernetes.io/projected/623bb1bb-ae87-465f-8efd-7439652ee175-kube-api-access-zj9g5\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.844770 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.844737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cthtb" event={"ID":"582534e8-13b3-4d5d-812e-eb3ebd52a66b","Type":"ContainerStarted","Data":"4219e88e6badabe16bfae53321955e51c8bc73f6af58c4ee8d84f511ff596301"} Jun 11 17:49:00.856342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.856314 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-x9fv7"] Jun 11 17:49:00.859603 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.859585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:00.862428 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.862262 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 17:49:00.862428 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.862281 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 17:49:00.862428 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.862283 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v5b9x\"" Jun 11 17:49:00.874370 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.874348 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-x9fv7"] Jun 11 17:49:00.929609 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.929581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623bb1bb-ae87-465f-8efd-7439652ee175-tmp\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.929762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.929629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/623bb1bb-ae87-465f-8efd-7439652ee175-klusterlet-config\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.929762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.929659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4dm\" (UniqueName: \"kubernetes.io/projected/737a9b2c-5901-4fc7-b8b1-a1989a259bfb-kube-api-access-6r4dm\") pod \"downloads-694c955b9-x9fv7\" (UID: \"737a9b2c-5901-4fc7-b8b1-a1989a259bfb\") " pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:00.929762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.929711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj9g5\" (UniqueName: \"kubernetes.io/projected/623bb1bb-ae87-465f-8efd-7439652ee175-kube-api-access-zj9g5\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.930062 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.930040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623bb1bb-ae87-465f-8efd-7439652ee175-tmp\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.932631 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.932610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/623bb1bb-ae87-465f-8efd-7439652ee175-klusterlet-config\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:00.939607 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:00.939580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj9g5\" (UniqueName: \"kubernetes.io/projected/623bb1bb-ae87-465f-8efd-7439652ee175-kube-api-access-zj9g5\") pod \"klusterlet-addon-workmgr-854f5477c5-vl8j2\" (UID: \"623bb1bb-ae87-465f-8efd-7439652ee175\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:01.031128 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.031050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4dm\" (UniqueName: \"kubernetes.io/projected/737a9b2c-5901-4fc7-b8b1-a1989a259bfb-kube-api-access-6r4dm\") pod \"downloads-694c955b9-x9fv7\" (UID: \"737a9b2c-5901-4fc7-b8b1-a1989a259bfb\") " pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:01.042351 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.042322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4dm\" (UniqueName: \"kubernetes.io/projected/737a9b2c-5901-4fc7-b8b1-a1989a259bfb-kube-api-access-6r4dm\") pod \"downloads-694c955b9-x9fv7\" (UID: \"737a9b2c-5901-4fc7-b8b1-a1989a259bfb\") " pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:01.072073 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.072043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:01.170652 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.170622 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:01.208193 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.207575 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2"] Jun 11 17:49:01.212473 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:01.212442 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623bb1bb_ae87_465f_8efd_7439652ee175.slice/crio-d852f338cabed437175318a6e6571bd1ae45689979dcb47646f2a11afacf508f WatchSource:0}: Error finding container d852f338cabed437175318a6e6571bd1ae45689979dcb47646f2a11afacf508f: Status 404 returned error can't find the container with id d852f338cabed437175318a6e6571bd1ae45689979dcb47646f2a11afacf508f Jun 11 17:49:01.325281 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.325256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-x9fv7"] Jun 11 17:49:01.849130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:01.849089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" event={"ID":"623bb1bb-ae87-465f-8efd-7439652ee175","Type":"ContainerStarted","Data":"d852f338cabed437175318a6e6571bd1ae45689979dcb47646f2a11afacf508f"} Jun 11 17:49:01.881401 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:01.881363 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737a9b2c_5901_4fc7_b8b1_a1989a259bfb.slice/crio-ebdd314be680e70640da96e8a64281d2fe7c31cf489c90d6e2501c29f19ff165 WatchSource:0}: Error finding container ebdd314be680e70640da96e8a64281d2fe7c31cf489c90d6e2501c29f19ff165: Status 404 returned error can't find the container with id ebdd314be680e70640da96e8a64281d2fe7c31cf489c90d6e2501c29f19ff165 Jun 11 17:49:02.858265 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:02.858226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cthtb" event={"ID":"582534e8-13b3-4d5d-812e-eb3ebd52a66b","Type":"ContainerStarted","Data":"fd344467984fb89ba91653d46122361c526cc032fc2b0d32850fd54d0dc6b7af"} Jun 11 17:49:02.860274 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:02.860248 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-x9fv7" event={"ID":"737a9b2c-5901-4fc7-b8b1-a1989a259bfb","Type":"ContainerStarted","Data":"ebdd314be680e70640da96e8a64281d2fe7c31cf489c90d6e2501c29f19ff165"} Jun 11 17:49:02.877232 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:02.876889 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cthtb" podStartSLOduration=17.731373958 podStartE2EDuration="23.876869486s" totalImagesPullingTime="6.145495528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:48:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:02.874779116 +0000 UTC m=+98.968872624" watchObservedRunningTime="2026-06-11 17:49:02.876869486 +0000 UTC m=+98.970962994" Jun 11 17:49:03.656684 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.656642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:03.656982 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.656702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:49:03.660999 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.659695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f1ec37-dc61-44e8-aa58-b2552536b972-metrics-tls\") pod \"dns-default-92hvr\" (UID: \"21f1ec37-dc61-44e8-aa58-b2552536b972\") " pod="openshift-dns/dns-default-92hvr" Jun 11 17:49:03.660999 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.660108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"image-registry-685c76c4d-bwm5q\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:03.670757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.670728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fr87q\"" Jun 11 17:49:03.678079 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.678049 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92hvr" Jun 11 17:49:03.824421 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.824383 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92hvr"] Jun 11 17:49:03.827815 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:03.827784 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f1ec37_dc61_44e8_aa58_b2552536b972.slice/crio-0ed66d7e41987c7e1519ce0be86329999045011f07d3d1069974c7d02d1bb5c6 WatchSource:0}: Error finding container 0ed66d7e41987c7e1519ce0be86329999045011f07d3d1069974c7d02d1bb5c6: Status 404 returned error can't find the container with id 0ed66d7e41987c7e1519ce0be86329999045011f07d3d1069974c7d02d1bb5c6 Jun 11 17:49:03.865830 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.865799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92hvr" event={"ID":"21f1ec37-dc61-44e8-aa58-b2552536b972","Type":"ContainerStarted","Data":"0ed66d7e41987c7e1519ce0be86329999045011f07d3d1069974c7d02d1bb5c6"} Jun 11 17:49:03.957867 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.957837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgbxm\"" Jun 11 17:49:03.966014 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:03.965972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:04.103989 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:04.103903 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:49:05.434672 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:05.434645 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777822ae_a10c_4b1a_9adc_d030f03b0360.slice/crio-8313ed9487c49498b8e5d311336dd6c2a9e926a30c5b7c03ce37d603cdb7ca99 WatchSource:0}: Error finding container 8313ed9487c49498b8e5d311336dd6c2a9e926a30c5b7c03ce37d603cdb7ca99: Status 404 returned error can't find the container with id 8313ed9487c49498b8e5d311336dd6c2a9e926a30c5b7c03ce37d603cdb7ca99 Jun 11 17:49:05.876323 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.875712 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" event={"ID":"623bb1bb-ae87-465f-8efd-7439652ee175","Type":"ContainerStarted","Data":"7f4db6057ad0c1854e260439ff8fd2c579e3e28b6f941cc5bf927e1a1a46f7f5"} Jun 11 17:49:05.876323 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.875936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:05.878935 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.877955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" event={"ID":"777822ae-a10c-4b1a-9adc-d030f03b0360","Type":"ContainerStarted","Data":"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2"} Jun 11 17:49:05.878935 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.878003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" event={"ID":"777822ae-a10c-4b1a-9adc-d030f03b0360","Type":"ContainerStarted","Data":"8313ed9487c49498b8e5d311336dd6c2a9e926a30c5b7c03ce37d603cdb7ca99"} Jun 11 17:49:05.878935 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.878469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:05.879203 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.879126 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" Jun 11 17:49:05.892747 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.892694 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-854f5477c5-vl8j2" podStartSLOduration=1.6017592710000002 podStartE2EDuration="5.892676746s" totalImagesPullingTime="4.290917475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:05.890655451 +0000 UTC m=+101.984748981" watchObservedRunningTime="2026-06-11 17:49:05.892676746 +0000 UTC m=+101.986770253" Jun 11 17:49:05.909203 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:05.909129 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" podStartSLOduration=101.909113901 podStartE2EDuration="1m41.909113901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:05.908250506 +0000 UTC m=+102.002344026" watchObservedRunningTime="2026-06-11 17:49:05.909113901 +0000 UTC m=+102.003207407" Jun 11 17:49:07.766865 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:07.766836 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lw8x4" Jun 11 17:49:07.887328 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:07.887232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92hvr" event={"ID":"21f1ec37-dc61-44e8-aa58-b2552536b972","Type":"ContainerStarted","Data":"de0069e34eaa366cb5727735c1dfeeec7ae2eeb698e4a55a6ba53b75ac7bb4c7"} Jun 11 17:49:07.887328 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:07.887297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92hvr" event={"ID":"21f1ec37-dc61-44e8-aa58-b2552536b972","Type":"ContainerStarted","Data":"3380e18b89bfdd5cf1cc13d6861d8185686405ebb614e081da60a95a8d4b76a5"} Jun 11 17:49:07.887499 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:07.887349 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-92hvr" Jun 11 17:49:07.904179 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:07.904134 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-92hvr" podStartSLOduration=65.435057997 podStartE2EDuration="1m8.904121179s" totalImagesPullingTime="3.469063182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:07.903139387 +0000 UTC m=+103.997232923" watchObservedRunningTime="2026-06-11 17:49:07.904121179 +0000 UTC m=+103.998214686" Jun 11 17:49:11.005620 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.005579 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx"] Jun 11 17:49:11.008290 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.008264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:11.010817 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.010796 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 17:49:11.010945 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.010819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sgbmb\"" Jun 11 17:49:11.016295 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.016243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx"] Jun 11 17:49:11.117914 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.117870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-fmbgx\" (UID: \"648a38c0-2ff6-49f8-9f6c-92f93c30321c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:11.218454 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.218415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-fmbgx\" (UID: \"648a38c0-2ff6-49f8-9f6c-92f93c30321c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:11.218611 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:11.218570 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 17:49:11.218674 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:11.218661 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates podName:648a38c0-2ff6-49f8-9f6c-92f93c30321c nodeName:}" failed. No retries permitted until 2026-06-11 17:49:11.718640041 +0000 UTC m=+107.812733541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-fmbgx" (UID: "648a38c0-2ff6-49f8-9f6c-92f93c30321c") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 17:49:11.723391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.723349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-fmbgx\" (UID: \"648a38c0-2ff6-49f8-9f6c-92f93c30321c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:11.726147 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.726119 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648a38c0-2ff6-49f8-9f6c-92f93c30321c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-fmbgx\" (UID: \"648a38c0-2ff6-49f8-9f6c-92f93c30321c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:11.919817 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:11.919782 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:12.042081 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:12.042007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx"] Jun 11 17:49:12.044431 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:12.044400 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648a38c0_2ff6_49f8_9f6c_92f93c30321c.slice/crio-6689941d1b3ae876a95df565a4d14940989f18bab021a71dbace4923233feb15 WatchSource:0}: Error finding container 6689941d1b3ae876a95df565a4d14940989f18bab021a71dbace4923233feb15: Status 404 returned error can't find the container with id 6689941d1b3ae876a95df565a4d14940989f18bab021a71dbace4923233feb15 Jun 11 17:49:12.910050 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:12.910016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" event={"ID":"648a38c0-2ff6-49f8-9f6c-92f93c30321c","Type":"ContainerStarted","Data":"6689941d1b3ae876a95df565a4d14940989f18bab021a71dbace4923233feb15"} Jun 11 17:49:13.915030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:13.914991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" event={"ID":"648a38c0-2ff6-49f8-9f6c-92f93c30321c","Type":"ContainerStarted","Data":"9a3fc6b5347c7e9c45fb16ca4f7ef19c8490e6a8cd1228bebc3619ffcdf5194f"} Jun 11 17:49:13.915485 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:13.915220 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:13.920663 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:13.920637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" Jun 11 17:49:13.933470 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:13.933427 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-fmbgx" podStartSLOduration=2.8446232670000002 podStartE2EDuration="3.933413014s" totalImagesPullingTime="1.088789747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:13.932231087 +0000 UTC m=+110.026324611" watchObservedRunningTime="2026-06-11 17:49:13.933413014 +0000 UTC m=+110.027506521" Jun 11 17:49:14.067769 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.067733 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9"] Jun 11 17:49:14.071493 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.071464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.074090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074064 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 17:49:14.074242 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 17:49:14.074242 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074206 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 17:49:14.074332 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074273 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5s5q9\"" Jun 11 17:49:14.074390 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074375 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 17:49:14.074525 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.074509 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 17:49:14.079841 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.079670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9"] Jun 11 17:49:14.241272 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.241204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.241272 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.241256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.241531 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.241318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.241531 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.241349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6p5\" (UniqueName: \"kubernetes.io/projected/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-kube-api-access-xt6p5\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.342731 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.342690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.342891 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.342747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.342891 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.342781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.342891 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.342807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6p5\" (UniqueName: \"kubernetes.io/projected/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-kube-api-access-xt6p5\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.342891 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:14.342878 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 17:49:14.343063 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:14.342958 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls podName:ef7118fa-2721-44f7-8d1e-f759b3bb0fc6 nodeName:}" failed. No retries permitted until 2026-06-11 17:49:14.842937537 +0000 UTC m=+110.937031035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-wmpc9" (UID: "ef7118fa-2721-44f7-8d1e-f759b3bb0fc6") : secret "prometheus-operator-tls" not found Jun 11 17:49:14.343614 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.343591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.345578 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.345554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.356900 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.355744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6p5\" (UniqueName: \"kubernetes.io/projected/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-kube-api-access-xt6p5\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.662152 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.662062 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:14.665500 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.665473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.670269 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.670243 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 17:49:14.670414 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.670246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6mzh4\"" Jun 11 17:49:14.671378 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.671357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 17:49:14.671496 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.671360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 17:49:14.671496 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.671455 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 17:49:14.671670 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.671647 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 17:49:14.678944 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.678922 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:14.847525 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.847701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.847701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.847701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwzv\" (UniqueName: \"kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.847701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.847904 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.847904 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.847829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.850255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.850228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef7118fa-2721-44f7-8d1e-f759b3bb0fc6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-wmpc9\" (UID: \"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:14.948436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.948436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.948930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwzv\" (UniqueName: \"kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.948930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.948930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.948930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.948856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.949233 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.949206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.949411 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.949387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.949534 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.949480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.951467 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.951443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.951554 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.951523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.957331 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.957301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwzv\" (UniqueName: \"kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv\") pod \"console-79dd47cbd5-nvmcc\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.977154 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.977132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:14.983418 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:14.983395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" Jun 11 17:49:17.893659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:17.893629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-92hvr" Jun 11 17:49:20.683968 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.683925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9"] Jun 11 17:49:20.687579 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:20.687546 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7118fa_2721_44f7_8d1e_f759b3bb0fc6.slice/crio-a101380f366a7ae530b3445fb92f9496dd3884ff30e0ed6378a03c55fb6c0626 WatchSource:0}: Error finding container a101380f366a7ae530b3445fb92f9496dd3884ff30e0ed6378a03c55fb6c0626: Status 404 returned error can't find the container with id a101380f366a7ae530b3445fb92f9496dd3884ff30e0ed6378a03c55fb6c0626 Jun 11 17:49:20.702756 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.702731 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:20.709195 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:20.709158 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab5931a_0b76_42ff_8ecd_c05b2c9c6f41.slice/crio-9a0d35208d841aaba4118e9485bc832542c4e0fa49fef185e9eb7e8b5bf70e04 WatchSource:0}: Error finding container 9a0d35208d841aaba4118e9485bc832542c4e0fa49fef185e9eb7e8b5bf70e04: Status 404 returned error can't find the container with id 9a0d35208d841aaba4118e9485bc832542c4e0fa49fef185e9eb7e8b5bf70e04 Jun 11 17:49:20.942637 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.942598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" event={"ID":"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6","Type":"ContainerStarted","Data":"a101380f366a7ae530b3445fb92f9496dd3884ff30e0ed6378a03c55fb6c0626"} Jun 11 17:49:20.943987 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.943950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dd47cbd5-nvmcc" event={"ID":"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41","Type":"ContainerStarted","Data":"9a0d35208d841aaba4118e9485bc832542c4e0fa49fef185e9eb7e8b5bf70e04"} Jun 11 17:49:20.945693 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.945637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-x9fv7" event={"ID":"737a9b2c-5901-4fc7-b8b1-a1989a259bfb","Type":"ContainerStarted","Data":"75bab1ad3cd3a51e5eb32001ff68301dbacaedc145ed2b8ef840285e57c913a9"} Jun 11 17:49:20.945946 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.945900 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:20.954670 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.954650 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-x9fv7" Jun 11 17:49:20.962288 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:20.962246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-x9fv7" podStartSLOduration=2.189330114 podStartE2EDuration="20.962233147s" totalImagesPullingTime="18.772903033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:20.961812201 +0000 UTC m=+117.055905708" watchObservedRunningTime="2026-06-11 17:49:20.962233147 +0000 UTC m=+117.056326652" Jun 11 17:49:23.035189 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:23.034332 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:49:23.041445 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:23.041394 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:24.970311 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.970268 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" event={"ID":"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6","Type":"ContainerStarted","Data":"3c34621a0ab71855fe5b15d672b86d4e91801799520ae595881ad69e7c1ee081"} Jun 11 17:49:24.970762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.970342 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" event={"ID":"ef7118fa-2721-44f7-8d1e-f759b3bb0fc6","Type":"ContainerStarted","Data":"bcdca2fac05bc28192e4d970a196f9c8e35d33e7d146d80302f5c6c03a3429f0"} Jun 11 17:49:24.972010 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.971981 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dd47cbd5-nvmcc" event={"ID":"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41","Type":"ContainerStarted","Data":"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6"} Jun 11 17:49:24.977625 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.977600 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:24.977725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.977699 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:24.983157 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.983136 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:24.987244 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:24.987200 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-wmpc9" podStartSLOduration=7.398792156 podStartE2EDuration="10.987162022s" totalImagesPullingTime="3.588369866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:24.987015889 +0000 UTC m=+121.081109396" watchObservedRunningTime="2026-06-11 17:49:24.987162022 +0000 UTC m=+121.081255532" Jun 11 17:49:25.003310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:25.003273 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79dd47cbd5-nvmcc" podStartSLOduration=7.11959305 podStartE2EDuration="11.003256625s" totalImagesPullingTime="3.883663575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:25.002426999 +0000 UTC m=+121.096520505" watchObservedRunningTime="2026-06-11 17:49:25.003256625 +0000 UTC m=+121.097350135" Jun 11 17:49:25.980407 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:25.980382 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:26.496747 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.496715 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9"] Jun 11 17:49:26.546504 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.546456 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jjxjk"] Jun 11 17:49:26.546667 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.546589 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.549546 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.549518 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 17:49:26.550027 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.550001 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9jp96\"" Jun 11 17:49:26.550570 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.550551 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 17:49:26.550665 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.550553 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 17:49:26.586421 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.586392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9"] Jun 11 17:49:26.586548 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.586523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.589460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.589430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jl6sd\"" Jun 11 17:49:26.589577 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.589508 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 17:49:26.589577 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.589557 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 17:49:26.589696 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.589657 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 17:49:26.649825 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.649788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.649991 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.649851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.649991 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.649877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-metrics-client-ca\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.649991 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.649904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.649991 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.649982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-root\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650039 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-textfile\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fls6g\" (UniqueName: \"kubernetes.io/projected/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-api-access-fls6g\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-sys\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-wtmp\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650482 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.650482 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-tls\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650482 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghsv\" (UniqueName: \"kubernetes.io/projected/ffd39343-cd1e-4f12-93f3-6269fb0c7190-kube-api-access-vghsv\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.650482 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.650338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f516fb0-d89b-422f-9d45-56e0763e25cb-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.751389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-root\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751389 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-textfile\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-root\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fls6g\" (UniqueName: \"kubernetes.io/projected/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-api-access-fls6g\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.751601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.751601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-sys\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-wtmp\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-sys\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-textfile\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-tls\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghsv\" (UniqueName: \"kubernetes.io/projected/ffd39343-cd1e-4f12-93f3-6269fb0c7190-kube-api-access-vghsv\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f516fb0-d89b-422f-9d45-56e0763e25cb-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.751791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-wtmp\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.752167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.752167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.752167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-metrics-client-ca\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.752167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.752167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.751993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.752454 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.752408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f516fb0-d89b-422f-9d45-56e0763e25cb-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.752605 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.752585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-metrics-client-ca\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.752930 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.752906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.753066 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.753040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.753134 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.753064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f516fb0-d89b-422f-9d45-56e0763e25cb-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.754569 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.754515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-tls\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.754754 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.754696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.755247 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.755210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.755368 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.755279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd39343-cd1e-4f12-93f3-6269fb0c7190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.760677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.760650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghsv\" (UniqueName: \"kubernetes.io/projected/ffd39343-cd1e-4f12-93f3-6269fb0c7190-kube-api-access-vghsv\") pod \"node-exporter-jjxjk\" (UID: \"ffd39343-cd1e-4f12-93f3-6269fb0c7190\") " pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.761050 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.761022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fls6g\" (UniqueName: \"kubernetes.io/projected/4f516fb0-d89b-422f-9d45-56e0763e25cb-kube-api-access-fls6g\") pod \"kube-state-metrics-678bc549d7-r4mx9\" (UID: \"4f516fb0-d89b-422f-9d45-56e0763e25cb\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.858343 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.858312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" Jun 11 17:49:26.897981 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.897953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jjxjk" Jun 11 17:49:26.982355 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:26.982320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjxjk" event={"ID":"ffd39343-cd1e-4f12-93f3-6269fb0c7190","Type":"ContainerStarted","Data":"e642cb8136281c06c87a7456c7f8e447b5cb4c8a6c0db7c4d13c06b20f0e8b37"} Jun 11 17:49:27.056085 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:27.055999 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9"] Jun 11 17:49:27.058966 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:27.058938 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f516fb0_d89b_422f_9d45_56e0763e25cb.slice/crio-da1de8bec8ad4612e8b822609aa07affd62847ce29394c12ebb533fde1abaf44 WatchSource:0}: Error finding container da1de8bec8ad4612e8b822609aa07affd62847ce29394c12ebb533fde1abaf44: Status 404 returned error can't find the container with id da1de8bec8ad4612e8b822609aa07affd62847ce29394c12ebb533fde1abaf44 Jun 11 17:49:27.991271 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:27.991230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" event={"ID":"4f516fb0-d89b-422f-9d45-56e0763e25cb","Type":"ContainerStarted","Data":"da1de8bec8ad4612e8b822609aa07affd62847ce29394c12ebb533fde1abaf44"} Jun 11 17:49:28.437956 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.436982 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4"] Jun 11 17:49:28.458213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.458112 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4"] Jun 11 17:49:28.458368 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.458264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.461511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461320 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 17:49:28.461511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461383 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 17:49:28.461511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461392 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3n1ovht2hgpn5\"" Jun 11 17:49:28.461511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 17:49:28.461814 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461649 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 17:49:28.461814 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 17:49:28.461814 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.461653 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-24ccd\"" Jun 11 17:49:28.570828 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.570792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.570828 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.570831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571059 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.570910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571059 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.570960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571059 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.571011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-metrics-client-ca\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571059 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.571043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwfp7\" (UniqueName: \"kubernetes.io/projected/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-kube-api-access-nwfp7\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571273 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.571074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-grpc-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.571273 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.571163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672420 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672420 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-metrics-client-ca\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwfp7\" (UniqueName: \"kubernetes.io/projected/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-kube-api-access-nwfp7\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.672658 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.672612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-grpc-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.673477 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.673425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-metrics-client-ca\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.675613 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.675586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.676069 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.676044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-grpc-tls\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.676069 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.676062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.676618 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.676597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.676716 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.676594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.677969 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.677945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.680346 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.680327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwfp7\" (UniqueName: \"kubernetes.io/projected/8e1689a6-7845-4167-8d8b-b1a5885f0d5b-kube-api-access-nwfp7\") pod \"thanos-querier-687b8d5b7b-ctlg4\" (UID: \"8e1689a6-7845-4167-8d8b-b1a5885f0d5b\") " pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:28.773574 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:28.773493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:29.279746 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:29.278992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4"] Jun 11 17:49:30.000708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.000662 2574 generic.go:356] "Generic (PLEG): container finished" podID="ffd39343-cd1e-4f12-93f3-6269fb0c7190" containerID="33f88801bb444fdc134d49cd83469ffeecbfff98388fd5f68178ce2a70d534c1" exitCode=0 Jun 11 17:49:30.000924 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.000749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjxjk" event={"ID":"ffd39343-cd1e-4f12-93f3-6269fb0c7190","Type":"ContainerDied","Data":"33f88801bb444fdc134d49cd83469ffeecbfff98388fd5f68178ce2a70d534c1"} Jun 11 17:49:30.003143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.003121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" event={"ID":"4f516fb0-d89b-422f-9d45-56e0763e25cb","Type":"ContainerStarted","Data":"5a7c4cc57e0a15a7abdc74517bd38bee4f75f57c8d39147d080c4752b72c896e"} Jun 11 17:49:30.003276 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.003163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" event={"ID":"4f516fb0-d89b-422f-9d45-56e0763e25cb","Type":"ContainerStarted","Data":"341e7d72f121837ad6ca71ebfe590a7dd095e4b37e06879466cdf8f129ab48c0"} Jun 11 17:49:30.003276 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.003213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" event={"ID":"4f516fb0-d89b-422f-9d45-56e0763e25cb","Type":"ContainerStarted","Data":"9d8453c155fe913a827bff0270b03180517d92f85f25859f686055e704ec50d6"} Jun 11 17:49:30.004514 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.004492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"1c6bf2499ce2671496dc4dcd8b47de18d1f23c3f258a06f50f88b75e0f160253"} Jun 11 17:49:30.038282 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.038243 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-r4mx9" podStartSLOduration=1.9854987130000001 podStartE2EDuration="4.038225644s" totalImagesPullingTime="2.052726931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:30.037368229 +0000 UTC m=+126.131461746" watchObservedRunningTime="2026-06-11 17:49:30.038225644 +0000 UTC m=+126.132319149" Jun 11 17:49:30.145560 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.145535 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:30.869297 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.869261 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54895d84b-z5khc"] Jun 11 17:49:30.901129 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.901090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54895d84b-z5khc"] Jun 11 17:49:30.901297 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.901231 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.904383 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.904359 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 17:49:30.905671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.905442 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bcdcedfun1h4s\"" Jun 11 17:49:30.905671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.905545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7gl8d\"" Jun 11 17:49:30.905671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.905561 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 17:49:30.905671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.905572 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 17:49:30.905671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.905597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 17:49:30.995623 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-tls\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-client-certs\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5d47c450-16c4-4fce-8b48-a09ffd632fc6-audit-log\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995797 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995951 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svksp\" (UniqueName: \"kubernetes.io/projected/5d47c450-16c4-4fce-8b48-a09ffd632fc6-kube-api-access-svksp\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995951 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-client-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:30.995951 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:30.995912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-metrics-server-audit-profiles\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.012149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.012115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjxjk" event={"ID":"ffd39343-cd1e-4f12-93f3-6269fb0c7190","Type":"ContainerStarted","Data":"240808c88a55fd69f69220e2faabc5caadab146177b7f70550803726ad1a1a50"} Jun 11 17:49:31.012320 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.012199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjxjk" event={"ID":"ffd39343-cd1e-4f12-93f3-6269fb0c7190","Type":"ContainerStarted","Data":"9156a184e08c524ffefd866f5db6f02503667ea9dc3542e4648f47e367406214"} Jun 11 17:49:31.032851 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.032796 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jjxjk" podStartSLOduration=2.742233557 podStartE2EDuration="5.032777952s" totalImagesPullingTime="2.170667662s" totalInitContainerRuntime="119.876733ms" isStatefulPod=true podCreationTimestamp="2026-06-11 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:31.032409222 +0000 UTC m=+127.126502729" watchObservedRunningTime="2026-06-11 17:49:31.032777952 +0000 UTC m=+127.126871462" Jun 11 17:49:31.097009 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.096978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097158 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svksp\" (UniqueName: \"kubernetes.io/projected/5d47c450-16c4-4fce-8b48-a09ffd632fc6-kube-api-access-svksp\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097158 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-client-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097158 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-metrics-server-audit-profiles\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097368 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-tls\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097368 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-client-certs\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097473 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5d47c450-16c4-4fce-8b48-a09ffd632fc6-audit-log\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.097857 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.097750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5d47c450-16c4-4fce-8b48-a09ffd632fc6-audit-log\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.098035 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.098013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.098279 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.098260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5d47c450-16c4-4fce-8b48-a09ffd632fc6-metrics-server-audit-profiles\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.099876 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.099850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-client-ca-bundle\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.099958 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.099920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-tls\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.100001 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.099955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5d47c450-16c4-4fce-8b48-a09ffd632fc6-secret-metrics-server-client-certs\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.104703 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.104683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svksp\" (UniqueName: \"kubernetes.io/projected/5d47c450-16c4-4fce-8b48-a09ffd632fc6-kube-api-access-svksp\") pod \"metrics-server-54895d84b-z5khc\" (UID: \"5d47c450-16c4-4fce-8b48-a09ffd632fc6\") " pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.211681 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.211490 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:31.364493 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:31.364469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54895d84b-z5khc"] Jun 11 17:49:31.513599 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:31.513525 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d47c450_16c4_4fce_8b48_a09ffd632fc6.slice/crio-17352990c312a4d5cf9d35d997e41b689545ba9d6598bb3658ac892c1b877976 WatchSource:0}: Error finding container 17352990c312a4d5cf9d35d997e41b689545ba9d6598bb3658ac892c1b877976: Status 404 returned error can't find the container with id 17352990c312a4d5cf9d35d997e41b689545ba9d6598bb3658ac892c1b877976 Jun 11 17:49:32.016650 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:32.016617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" event={"ID":"5d47c450-16c4-4fce-8b48-a09ffd632fc6","Type":"ContainerStarted","Data":"17352990c312a4d5cf9d35d997e41b689545ba9d6598bb3658ac892c1b877976"} Jun 11 17:49:32.018607 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:32.018583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"132f2996d0d85457b0e3b3e4e468119412b6ff511d084b3f61d96a344a5648f4"} Jun 11 17:49:32.018708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:32.018635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"34c5bc5c900f9f15f6554a7076381e849517379ce98dd2c70ee2d33edce2d2ff"} Jun 11 17:49:32.018708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:32.018662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"23d2d051cafd0ba373bb108a787f7a2e96b0b5698778d5614ba57426ab5c8a35"} Jun 11 17:49:34.029607 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.029574 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"f392485745112758d4d505b56cb8a4d9e5fb9a30a879faa1d28f7edad5a9fd6d"} Jun 11 17:49:34.030031 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.029653 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"28ef676256b4f7d456cda3135613211c193facbe26b05941013d24052fc95fbf"} Jun 11 17:49:34.031062 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.031029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" event={"ID":"5d47c450-16c4-4fce-8b48-a09ffd632fc6","Type":"ContainerStarted","Data":"c95d31f81372a9a5024a17beea2246799a530e98b6d90776e82de8cd330aa62a"} Jun 11 17:49:34.049367 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.049312 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" podStartSLOduration=1.859809636 podStartE2EDuration="4.049291369s" totalImagesPullingTime="2.189481733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:34.047874382 +0000 UTC m=+130.141967904" watchObservedRunningTime="2026-06-11 17:49:34.049291369 +0000 UTC m=+130.143384876" Jun 11 17:49:34.227455 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.227417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:49:34.229850 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.229785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee875c8a-b9c4-45e0-954d-bc0a5ae887b5-metrics-certs\") pod \"network-metrics-daemon-4v2rl\" (UID: \"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5\") " pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:49:34.296046 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.296017 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jffb6\"" Jun 11 17:49:34.304312 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.304293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4v2rl" Jun 11 17:49:34.446962 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:34.446933 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4v2rl"] Jun 11 17:49:34.449851 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:49:34.449824 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee875c8a_b9c4_45e0_954d_bc0a5ae887b5.slice/crio-7bd3d658029ed7679642ba645714c40de7e00f8c8a652e74b2e12b7515d620ff WatchSource:0}: Error finding container 7bd3d658029ed7679642ba645714c40de7e00f8c8a652e74b2e12b7515d620ff: Status 404 returned error can't find the container with id 7bd3d658029ed7679642ba645714c40de7e00f8c8a652e74b2e12b7515d620ff Jun 11 17:49:35.037715 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:35.037670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v2rl" event={"ID":"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5","Type":"ContainerStarted","Data":"7bd3d658029ed7679642ba645714c40de7e00f8c8a652e74b2e12b7515d620ff"} Jun 11 17:49:35.041322 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:35.041284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" event={"ID":"8e1689a6-7845-4167-8d8b-b1a5885f0d5b","Type":"ContainerStarted","Data":"0429a10e1ce2068c9aed4719d1902b02361109c645031dd8884c26433c08e2a0"} Jun 11 17:49:35.065995 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:35.065942 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" podStartSLOduration=2.974114793 podStartE2EDuration="7.065928597s" totalImagesPullingTime="4.091813804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:49:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:35.06568957 +0000 UTC m=+131.159783079" watchObservedRunningTime="2026-06-11 17:49:35.065928597 +0000 UTC m=+131.160022114" Jun 11 17:49:36.044940 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:36.044908 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:36.050473 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:36.050451 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-687b8d5b7b-ctlg4" Jun 11 17:49:37.049858 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:37.049816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v2rl" event={"ID":"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5","Type":"ContainerStarted","Data":"642e474e374389029a0fa2b0517e4a12c0c6f16bd2bc14d4c6d683aaab6f59e9"} Jun 11 17:49:37.049858 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:37.049866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4v2rl" event={"ID":"ee875c8a-b9c4-45e0-954d-bc0a5ae887b5","Type":"ContainerStarted","Data":"3c839a2d3e1c6877449b93f49105d0a658b16af0e8a2f1dac4775d70b30f048f"} Jun 11 17:49:37.070328 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:37.070274 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4v2rl" podStartSLOduration=131.449045368 podStartE2EDuration="2m13.070258539s" totalImagesPullingTime="1.621213171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:49:37.069688887 +0000 UTC m=+133.163782394" watchObservedRunningTime="2026-06-11 17:49:37.070258539 +0000 UTC m=+133.164352044" Jun 11 17:49:48.062037 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.061978 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" podUID="777822ae-a10c-4b1a-9adc-d030f03b0360" containerName="registry" containerID="cri-o://4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2" gracePeriod=30 Jun 11 17:49:48.345554 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.345532 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:48.451054 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6snh2\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451203 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451068 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451203 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451091 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451213 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451247 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451306 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451506 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451335 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca\") pod \"777822ae-a10c-4b1a-9adc-d030f03b0360\" (UID: \"777822ae-a10c-4b1a-9adc-d030f03b0360\") " Jun 11 17:49:48.451763 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.451733 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:49:48.452342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.452273 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:49:48.453638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.453612 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:49:48.453736 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.453640 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:49:48.453880 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.453854 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2" (OuterVolumeSpecName: "kube-api-access-6snh2") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "kube-api-access-6snh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:49:48.453922 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.453895 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:49:48.454125 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.454103 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:49:48.459995 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.459971 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "777822ae-a10c-4b1a-9adc-d030f03b0360" (UID: "777822ae-a10c-4b1a-9adc-d030f03b0360"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:49:48.552092 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552071 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-bound-sa-token\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552095 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-image-registry-private-configuration\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552105 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-certificates\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552115 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777822ae-a10c-4b1a-9adc-d030f03b0360-ca-trust-extracted\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552124 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777822ae-a10c-4b1a-9adc-d030f03b0360-trusted-ca\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552132 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6snh2\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-kube-api-access-6snh2\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552140 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777822ae-a10c-4b1a-9adc-d030f03b0360-installation-pull-secrets\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:48.552200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:48.552149 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777822ae-a10c-4b1a-9adc-d030f03b0360-registry-tls\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:49.095506 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.095473 2574 generic.go:356] "Generic (PLEG): container finished" podID="777822ae-a10c-4b1a-9adc-d030f03b0360" containerID="4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2" exitCode=0 Jun 11 17:49:49.095994 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.095516 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" Jun 11 17:49:49.095994 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.095559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" event={"ID":"777822ae-a10c-4b1a-9adc-d030f03b0360","Type":"ContainerDied","Data":"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2"} Jun 11 17:49:49.095994 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.095620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685c76c4d-bwm5q" event={"ID":"777822ae-a10c-4b1a-9adc-d030f03b0360","Type":"ContainerDied","Data":"8313ed9487c49498b8e5d311336dd6c2a9e926a30c5b7c03ce37d603cdb7ca99"} Jun 11 17:49:49.095994 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.095653 2574 scope.go:117] "RemoveContainer" containerID="4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2" Jun 11 17:49:49.106659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.106628 2574 scope.go:117] "RemoveContainer" containerID="4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2" Jun 11 17:49:49.107379 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:49.107354 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2\": container with ID starting with 4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2 not found: ID does not exist" containerID="4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2" Jun 11 17:49:49.107451 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.107386 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2"} err="failed to get container status \"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2\": rpc error: code = NotFound desc = could not find container \"4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2\": container with ID starting with 4e797e31450f72f134062830fd227bd8a032d77b826b46fd14e1b53a9285b2d2 not found: ID does not exist" Jun 11 17:49:49.117296 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.117275 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:49:49.121550 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:49.121531 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-685c76c4d-bwm5q"] Jun 11 17:49:50.374438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:50.374398 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777822ae-a10c-4b1a-9adc-d030f03b0360" path="/var/lib/kubelet/pods/777822ae-a10c-4b1a-9adc-d030f03b0360/volumes" Jun 11 17:49:51.212360 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:51.212333 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:51.212547 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:51.212390 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:49:55.179588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.179491 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79dd47cbd5-nvmcc" podUID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" containerName="console" containerID="cri-o://e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6" gracePeriod=15 Jun 11 17:49:55.466014 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.465989 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:55.603973 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.603943 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbwzv\" (UniqueName: \"kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604133 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.603982 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604133 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604007 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604133 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604031 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604133 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604062 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604133 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604089 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config\") pod \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\" (UID: \"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41\") " Jun 11 17:49:55.604573 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604541 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca" (OuterVolumeSpecName: "service-ca") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:49:55.604682 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604548 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:49:55.604682 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.604549 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config" (OuterVolumeSpecName: "console-config") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:49:55.606291 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.606154 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:49:55.606291 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.606238 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv" (OuterVolumeSpecName: "kube-api-access-xbwzv") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "kube-api-access-xbwzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:49:55.606423 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.606376 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" (UID: "eab5931a-0b76-42ff-8ecd-c05b2c9c6f41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:49:55.704586 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704562 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-service-ca\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:55.704586 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704584 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:55.704732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704593 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbwzv\" (UniqueName: \"kubernetes.io/projected/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-kube-api-access-xbwzv\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:55.704732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704602 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-oauth-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:55.704732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704611 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:55.704732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:55.704619 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41-console-oauth-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:49:56.124537 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.124451 2574 generic.go:356] "Generic (PLEG): container finished" podID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" containerID="e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6" exitCode=0 Jun 11 17:49:56.124537 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.124494 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79dd47cbd5-nvmcc" Jun 11 17:49:56.124772 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.124496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dd47cbd5-nvmcc" event={"ID":"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41","Type":"ContainerDied","Data":"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6"} Jun 11 17:49:56.124772 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.124641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79dd47cbd5-nvmcc" event={"ID":"eab5931a-0b76-42ff-8ecd-c05b2c9c6f41","Type":"ContainerDied","Data":"9a0d35208d841aaba4118e9485bc832542c4e0fa49fef185e9eb7e8b5bf70e04"} Jun 11 17:49:56.124772 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.124669 2574 scope.go:117] "RemoveContainer" containerID="e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6" Jun 11 17:49:56.132909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.132893 2574 scope.go:117] "RemoveContainer" containerID="e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6" Jun 11 17:49:56.133139 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:49:56.133121 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6\": container with ID starting with e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6 not found: ID does not exist" containerID="e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6" Jun 11 17:49:56.133222 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.133145 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6"} err="failed to get container status \"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6\": rpc error: code = NotFound desc = could not find container \"e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6\": container with ID starting with e29261fd3d586b5a26c7761aa04c55220d3843d56c1f2a961b29ac72ea3855d6 not found: ID does not exist" Jun 11 17:49:56.144664 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.144638 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:56.148130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.148109 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79dd47cbd5-nvmcc"] Jun 11 17:49:56.374090 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:49:56.374064 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" path="/var/lib/kubelet/pods/eab5931a-0b76-42ff-8ecd-c05b2c9c6f41/volumes" Jun 11 17:50:11.218419 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:11.218390 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:50:11.222877 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:11.222849 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54895d84b-z5khc" Jun 11 17:50:48.286312 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286269 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286619 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777822ae-a10c-4b1a-9adc-d030f03b0360" containerName="registry" Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286635 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="777822ae-a10c-4b1a-9adc-d030f03b0360" containerName="registry" Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286659 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" containerName="console" Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286670 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" containerName="console" Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286725 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab5931a-0b76-42ff-8ecd-c05b2c9c6f41" containerName="console" Jun 11 17:50:48.286780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.286734 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="777822ae-a10c-4b1a-9adc-d030f03b0360" containerName="registry" Jun 11 17:50:48.289166 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.289148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.291672 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 17:50:48.291818 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291673 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gzq84\"" Jun 11 17:50:48.291818 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291746 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 17:50:48.291982 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 17:50:48.291982 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 17:50:48.291982 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.291942 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 17:50:48.292243 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.292228 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 17:50:48.292327 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.292255 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 17:50:48.292327 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.292263 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 17:50:48.297357 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.297338 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 17:50:48.302315 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.302292 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:50:48.394969 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.394947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.394979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-config-out\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-web-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-tls-assets\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc9z\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-kube-api-access-jjc9z\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395342 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-config-volume\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395535 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.395535 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.395388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496629 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-config-out\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496629 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-web-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496629 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496629 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496629 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-tls-assets\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496877 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc9z\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-kube-api-access-jjc9z\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496877 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.496877 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.497030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.496957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.497030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.497008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-config-volume\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.497128 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.497039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.497128 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.497070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.497267 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.497135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.498145 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.498120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.498940 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.498919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234ecb41-6917-4b4c-9efb-565178d59694-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.499371 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.499343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/234ecb41-6917-4b4c-9efb-565178d59694-config-out\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.499823 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.499767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-tls-assets\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.499916 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.499822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.500020 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.499995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.500083 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.500065 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-web-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.500123 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.500087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-config-volume\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.500492 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.500471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.501447 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.501428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.501668 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.501652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/234ecb41-6917-4b4c-9efb-565178d59694-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.504503 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.504480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc9z\" (UniqueName: \"kubernetes.io/projected/234ecb41-6917-4b4c-9efb-565178d59694-kube-api-access-jjc9z\") pod \"alertmanager-main-0\" (UID: \"234ecb41-6917-4b4c-9efb-565178d59694\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.599641 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.599585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:50:48.733718 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:48.733694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:50:48.734909 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:50:48.734884 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234ecb41_6917_4b4c_9efb_565178d59694.slice/crio-738344ed31bb31eeaabf76deebb5688fe1302a54b2865582161c90df25239a79 WatchSource:0}: Error finding container 738344ed31bb31eeaabf76deebb5688fe1302a54b2865582161c90df25239a79: Status 404 returned error can't find the container with id 738344ed31bb31eeaabf76deebb5688fe1302a54b2865582161c90df25239a79 Jun 11 17:50:49.324988 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:49.324946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"738344ed31bb31eeaabf76deebb5688fe1302a54b2865582161c90df25239a79"} Jun 11 17:50:50.330667 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.330633 2574 generic.go:356] "Generic (PLEG): container finished" podID="234ecb41-6917-4b4c-9efb-565178d59694" containerID="9b93c21b1394ef02518e98fecccd2f880945d5741ef251dc5b3df35cc1cbc335" exitCode=0 Jun 11 17:50:50.331033 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.330688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerDied","Data":"9b93c21b1394ef02518e98fecccd2f880945d5741ef251dc5b3df35cc1cbc335"} Jun 11 17:50:50.775479 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.775439 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8547b66d9c-2x7p5"] Jun 11 17:50:50.778494 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.778469 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.781522 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.781497 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 17:50:50.781643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.781549 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nxfdh\"" Jun 11 17:50:50.781998 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.781975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 17:50:50.781998 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.781990 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 17:50:50.782788 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.782764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 17:50:50.782892 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.782847 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 17:50:50.786887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.786862 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 17:50:50.791614 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.791587 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8547b66d9c-2x7p5"] Jun 11 17:50:50.919113 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-metrics-client-ca\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919371 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9kx\" (UniqueName: \"kubernetes.io/projected/02d59574-36cd-4167-bee7-00f378f49d96-kube-api-access-lg9kx\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919503 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919618 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-federate-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919748 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-serving-certs-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919848 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.919946 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.919934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:50.920038 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:50.920027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021585 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-serving-certs-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-metrics-client-ca\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.021757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9kx\" (UniqueName: \"kubernetes.io/projected/02d59574-36cd-4167-bee7-00f378f49d96-kube-api-access-lg9kx\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.022006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.022006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.021799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-federate-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.022469 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.022440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-serving-certs-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.022632 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.022585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-metrics-client-ca\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.022971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.022942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.025140 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.025095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.025294 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.025269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-secret-telemeter-client\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.025362 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.025277 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-federate-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.025522 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.025480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/02d59574-36cd-4167-bee7-00f378f49d96-telemeter-client-tls\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.029710 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.029685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9kx\" (UniqueName: \"kubernetes.io/projected/02d59574-36cd-4167-bee7-00f378f49d96-kube-api-access-lg9kx\") pod \"telemeter-client-8547b66d9c-2x7p5\" (UID: \"02d59574-36cd-4167-bee7-00f378f49d96\") " pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.091636 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.091599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" Jun 11 17:50:51.257317 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.257289 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8547b66d9c-2x7p5"] Jun 11 17:50:51.270649 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:50:51.270608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d59574_36cd_4167_bee7_00f378f49d96.slice/crio-3d744ad6af5850f9848e8b13dfb9f02e4d0b757a54c6c43573cc89a950cafb1b WatchSource:0}: Error finding container 3d744ad6af5850f9848e8b13dfb9f02e4d0b757a54c6c43573cc89a950cafb1b: Status 404 returned error can't find the container with id 3d744ad6af5850f9848e8b13dfb9f02e4d0b757a54c6c43573cc89a950cafb1b Jun 11 17:50:51.337925 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:51.337891 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" event={"ID":"02d59574-36cd-4167-bee7-00f378f49d96","Type":"ContainerStarted","Data":"3d744ad6af5850f9848e8b13dfb9f02e4d0b757a54c6c43573cc89a950cafb1b"} Jun 11 17:50:52.346506 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"4bc743643946b15f25d6d315958671bae34d21ec51a684b8aceb15643b0c14d9"} Jun 11 17:50:52.347463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"2f0831a2415c5c16687214b78f576a48e8cfa16c182f0ea74529ac12015690a0"} Jun 11 17:50:52.347463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"844a71a328a67c3dff45ed3df58a5024c3ecf5256ca8cbb0f793e52492c40831"} Jun 11 17:50:52.347463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346611 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"1f186dbe35c8331d798720f55518a1a84607790e7b5fe259764a2908924e29c7"} Jun 11 17:50:52.347463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"59d8e4d2424962d26a6db421b5b5c0dda037e0c570bdafa5701a8b996f810551"} Jun 11 17:50:52.347463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.346667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"234ecb41-6917-4b4c-9efb-565178d59694","Type":"ContainerStarted","Data":"99d1811ef51556e37d3041c2bfb05b750abe2ad96e18f2093d16898ca205a87e"} Jun 11 17:50:52.373961 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:52.373910 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.720015479 podStartE2EDuration="4.373889665s" totalImagesPullingTime="2.63711337s" totalInitContainerRuntime="16.760816ms" isStatefulPod=false podCreationTimestamp="2026-06-11 17:50:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:50:52.371396613 +0000 UTC m=+208.465490120" watchObservedRunningTime="2026-06-11 17:50:52.373889665 +0000 UTC m=+208.467983172" Jun 11 17:50:54.356461 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:54.356368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" event={"ID":"02d59574-36cd-4167-bee7-00f378f49d96","Type":"ContainerStarted","Data":"145d08952eb120cabe59fd1fc2311a73698993734213a4d65807b43cdcc66894"} Jun 11 17:50:54.356461 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:54.356431 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" event={"ID":"02d59574-36cd-4167-bee7-00f378f49d96","Type":"ContainerStarted","Data":"d909595647a66f7678a226d23d78e6337f96112057f79a2a68b52cc1ae691a0b"} Jun 11 17:50:54.356461 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:54.356458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" event={"ID":"02d59574-36cd-4167-bee7-00f378f49d96","Type":"ContainerStarted","Data":"303f6e2f47f77e4f8773b4474dc1c0bd5dc033f79082ab812a49773daf2acdab"} Jun 11 17:50:54.380585 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:54.379774 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8547b66d9c-2x7p5" podStartSLOduration=1.582967063 podStartE2EDuration="4.379754275s" totalImagesPullingTime="2.796787212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:50:54.377526419 +0000 UTC m=+210.471620001" watchObservedRunningTime="2026-06-11 17:50:54.379754275 +0000 UTC m=+210.473847782" Jun 11 17:50:55.104762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.104718 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:50:55.107452 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.107430 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.110065 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.110035 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 17:50:55.111443 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.111417 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 17:50:55.111714 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.111655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6mzh4\"" Jun 11 17:50:55.111881 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.111864 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 17:50:55.112007 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.111983 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 17:50:55.112143 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.112117 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 17:50:55.116197 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.116159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 17:50:55.119724 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.119699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:50:55.260476 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260677 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260897 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.260897 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.260726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mdpk\" (UniqueName: \"kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362120 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362120 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362120 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362660 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362660 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362660 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362660 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mdpk\" (UniqueName: \"kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362960 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362915 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.362996 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.362974 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.363131 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.363116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.364743 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.364710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.364863 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.364781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.369837 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.369812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mdpk\" (UniqueName: \"kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk\") pod \"console-6dfbcd79f6-lt8fs\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.420887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.420860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:50:55.546761 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:55.546735 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:50:55.549820 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:50:55.549793 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93933f14_e375_4f1a_8de1_76c3b1ebd862.slice/crio-e814f85b02a853d99fbe2e1723a75c7a78c48cc9fb9077e4d0dfca0bfe8b5e01 WatchSource:0}: Error finding container e814f85b02a853d99fbe2e1723a75c7a78c48cc9fb9077e4d0dfca0bfe8b5e01: Status 404 returned error can't find the container with id e814f85b02a853d99fbe2e1723a75c7a78c48cc9fb9077e4d0dfca0bfe8b5e01 Jun 11 17:50:56.365946 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:56.365909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbcd79f6-lt8fs" event={"ID":"93933f14-e375-4f1a-8de1-76c3b1ebd862","Type":"ContainerStarted","Data":"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb"} Jun 11 17:50:56.366312 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:56.365967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbcd79f6-lt8fs" event={"ID":"93933f14-e375-4f1a-8de1-76c3b1ebd862","Type":"ContainerStarted","Data":"e814f85b02a853d99fbe2e1723a75c7a78c48cc9fb9077e4d0dfca0bfe8b5e01"} Jun 11 17:50:56.384155 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:50:56.384104 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dfbcd79f6-lt8fs" podStartSLOduration=1.384088332 podStartE2EDuration="1.384088332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:50:56.381609599 +0000 UTC m=+212.475703105" watchObservedRunningTime="2026-06-11 17:50:56.384088332 +0000 UTC m=+212.478181903" Jun 11 17:51:05.421704 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:51:05.421670 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:51:05.422157 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:51:05.421766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:51:05.426425 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:51:05.426404 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:51:06.408020 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:51:06.407993 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:52:05.191410 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.191370 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:52:05.195062 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.195042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.204439 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.204413 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:52:05.217068 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xsf\" (UniqueName: \"kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217357 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.217357 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.217272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.317909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.317868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.317953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.317984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xsf\" (UniqueName: \"kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318422 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318821 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318821 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.318986 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.318815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.319044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.319005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.320496 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.320460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.320594 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.320531 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.325882 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.325859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xsf\" (UniqueName: \"kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf\") pod \"console-6479db759b-nwvkr\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.506066 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.505972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:05.651220 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:05.651197 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:52:05.653245 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:52:05.653220 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fbccac_759a_4291_8cfe_3fd6d8bc5609.slice/crio-c029a0381bc724bd6f74ff98993ca8a44d1c69dc9fde2d7bf172a772f249ea3c WatchSource:0}: Error finding container c029a0381bc724bd6f74ff98993ca8a44d1c69dc9fde2d7bf172a772f249ea3c: Status 404 returned error can't find the container with id c029a0381bc724bd6f74ff98993ca8a44d1c69dc9fde2d7bf172a772f249ea3c Jun 11 17:52:06.630851 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:06.630818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479db759b-nwvkr" event={"ID":"13fbccac-759a-4291-8cfe-3fd6d8bc5609","Type":"ContainerStarted","Data":"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164"} Jun 11 17:52:06.631226 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:06.630867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479db759b-nwvkr" event={"ID":"13fbccac-759a-4291-8cfe-3fd6d8bc5609","Type":"ContainerStarted","Data":"c029a0381bc724bd6f74ff98993ca8a44d1c69dc9fde2d7bf172a772f249ea3c"} Jun 11 17:52:06.648588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:06.648539 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6479db759b-nwvkr" podStartSLOduration=1.6485254550000001 podStartE2EDuration="1.648525455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:52:06.647117159 +0000 UTC m=+282.741210741" watchObservedRunningTime="2026-06-11 17:52:06.648525455 +0000 UTC m=+282.742618960" Jun 11 17:52:15.506712 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:15.506666 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:15.507151 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:15.506754 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:15.511293 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:15.511275 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:15.671579 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:15.671553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:52:15.716958 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:15.716924 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:52:24.313193 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:24.313147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:52:24.313671 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:24.313608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:52:24.324398 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:24.324378 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 17:52:40.737794 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:40.737752 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dfbcd79f6-lt8fs" podUID="93933f14-e375-4f1a-8de1-76c3b1ebd862" containerName="console" containerID="cri-o://086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb" gracePeriod=15 Jun 11 17:52:40.982799 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:40.982775 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:52:41.094290 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094203 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094290 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094237 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094301 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094358 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094390 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094416 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094447 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mdpk\" (UniqueName: \"kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk\") pod \"93933f14-e375-4f1a-8de1-76c3b1ebd862\" (UID: \"93933f14-e375-4f1a-8de1-76c3b1ebd862\") " Jun 11 17:52:41.094757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094642 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca" (OuterVolumeSpecName: "service-ca") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:52:41.094815 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094759 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config" (OuterVolumeSpecName: "console-config") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:52:41.094871 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094856 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-service-ca\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.094921 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094876 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.094921 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.094870 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:52:41.095054 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.095031 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:52:41.096650 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.096629 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:52:41.096650 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.096635 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk" (OuterVolumeSpecName: "kube-api-access-9mdpk") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "kube-api-access-9mdpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:52:41.096782 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.096655 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93933f14-e375-4f1a-8de1-76c3b1ebd862" (UID: "93933f14-e375-4f1a-8de1-76c3b1ebd862"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:52:41.195901 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.195872 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mdpk\" (UniqueName: \"kubernetes.io/projected/93933f14-e375-4f1a-8de1-76c3b1ebd862-kube-api-access-9mdpk\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.195901 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.195899 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-oauth-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.196061 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.195911 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93933f14-e375-4f1a-8de1-76c3b1ebd862-trusted-ca-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.196061 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.195921 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-oauth-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.196061 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.195930 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93933f14-e375-4f1a-8de1-76c3b1ebd862-console-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:52:41.768972 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.768939 2574 generic.go:356] "Generic (PLEG): container finished" podID="93933f14-e375-4f1a-8de1-76c3b1ebd862" containerID="086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb" exitCode=0 Jun 11 17:52:41.769366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.768987 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbcd79f6-lt8fs" Jun 11 17:52:41.769366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.769024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbcd79f6-lt8fs" event={"ID":"93933f14-e375-4f1a-8de1-76c3b1ebd862","Type":"ContainerDied","Data":"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb"} Jun 11 17:52:41.769366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.769072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbcd79f6-lt8fs" event={"ID":"93933f14-e375-4f1a-8de1-76c3b1ebd862","Type":"ContainerDied","Data":"e814f85b02a853d99fbe2e1723a75c7a78c48cc9fb9077e4d0dfca0bfe8b5e01"} Jun 11 17:52:41.769366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.769093 2574 scope.go:117] "RemoveContainer" containerID="086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb" Jun 11 17:52:41.777690 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.777675 2574 scope.go:117] "RemoveContainer" containerID="086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb" Jun 11 17:52:41.777921 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:52:41.777903 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb\": container with ID starting with 086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb not found: ID does not exist" containerID="086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb" Jun 11 17:52:41.777969 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.777928 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb"} err="failed to get container status \"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb\": rpc error: code = NotFound desc = could not find container \"086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb\": container with ID starting with 086f7423c04ca943773e2df07e6b00c2a09048973f273ee4dc81f0bae9d928eb not found: ID does not exist" Jun 11 17:52:41.790743 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.790723 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:52:41.792031 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:41.792013 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dfbcd79f6-lt8fs"] Jun 11 17:52:42.375044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:42.375002 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93933f14-e375-4f1a-8de1-76c3b1ebd862" path="/var/lib/kubelet/pods/93933f14-e375-4f1a-8de1-76c3b1ebd862/volumes" Jun 11 17:52:43.199419 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.199388 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9"] Jun 11 17:52:43.199775 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.199698 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93933f14-e375-4f1a-8de1-76c3b1ebd862" containerName="console" Jun 11 17:52:43.199775 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.199709 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93933f14-e375-4f1a-8de1-76c3b1ebd862" containerName="console" Jun 11 17:52:43.199775 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.199768 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93933f14-e375-4f1a-8de1-76c3b1ebd862" containerName="console" Jun 11 17:52:43.205672 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.205216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.208041 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.208017 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:52:43.208191 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.208050 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:52:43.208191 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.208127 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:52:43.213638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.213618 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9"] Jun 11 17:52:43.313417 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.313382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.313573 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.313426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rn6\" (UniqueName: \"kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.313573 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.313537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.414240 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.414212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.414345 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.414266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.414345 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.414295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rn6\" (UniqueName: \"kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.414594 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.414567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.414634 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.414604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.426495 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.426470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rn6\" (UniqueName: \"kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.515485 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.515415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:52:43.643514 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.643451 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9"] Jun 11 17:52:43.645865 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:52:43.645834 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d76afe4_9c39_43fd_affe_a2af42259a83.slice/crio-1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148 WatchSource:0}: Error finding container 1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148: Status 404 returned error can't find the container with id 1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148 Jun 11 17:52:43.651622 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.651607 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:52:43.778542 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:43.778479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" event={"ID":"9d76afe4-9c39-43fd-affe-a2af42259a83","Type":"ContainerStarted","Data":"1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148"} Jun 11 17:52:50.810185 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:50.810138 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerID="7b676b11676c6eaa722b8b4ba8aec46ea4401b40c80dd282bfc7be55241c8535" exitCode=0 Jun 11 17:52:50.810596 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:50.810198 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" event={"ID":"9d76afe4-9c39-43fd-affe-a2af42259a83","Type":"ContainerDied","Data":"7b676b11676c6eaa722b8b4ba8aec46ea4401b40c80dd282bfc7be55241c8535"} Jun 11 17:52:55.832633 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:55.832599 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerID="76e7229ba28b2ebbb0246134c3385aa53ecd8f5cb3f7af6982b09e643cd89415" exitCode=0 Jun 11 17:52:55.832996 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:52:55.832672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" event={"ID":"9d76afe4-9c39-43fd-affe-a2af42259a83","Type":"ContainerDied","Data":"76e7229ba28b2ebbb0246134c3385aa53ecd8f5cb3f7af6982b09e643cd89415"} Jun 11 17:53:03.875017 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:03.874949 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerID="6414316a41f353bc830ccb277fa67c2684c4b793d31c3618bfd6b965500f173f" exitCode=0 Jun 11 17:53:03.875324 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:03.875040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" event={"ID":"9d76afe4-9c39-43fd-affe-a2af42259a83","Type":"ContainerDied","Data":"6414316a41f353bc830ccb277fa67c2684c4b793d31c3618bfd6b965500f173f"} Jun 11 17:53:05.000104 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.000083 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:53:05.007780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.007760 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util\") pod \"9d76afe4-9c39-43fd-affe-a2af42259a83\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " Jun 11 17:53:05.007904 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.007803 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle\") pod \"9d76afe4-9c39-43fd-affe-a2af42259a83\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " Jun 11 17:53:05.007904 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.007821 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2rn6\" (UniqueName: \"kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6\") pod \"9d76afe4-9c39-43fd-affe-a2af42259a83\" (UID: \"9d76afe4-9c39-43fd-affe-a2af42259a83\") " Jun 11 17:53:05.008406 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.008383 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle" (OuterVolumeSpecName: "bundle") pod "9d76afe4-9c39-43fd-affe-a2af42259a83" (UID: "9d76afe4-9c39-43fd-affe-a2af42259a83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:05.009854 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.009831 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6" (OuterVolumeSpecName: "kube-api-access-p2rn6") pod "9d76afe4-9c39-43fd-affe-a2af42259a83" (UID: "9d76afe4-9c39-43fd-affe-a2af42259a83"). InnerVolumeSpecName "kube-api-access-p2rn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:53:05.012091 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.012066 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util" (OuterVolumeSpecName: "util") pod "9d76afe4-9c39-43fd-affe-a2af42259a83" (UID: "9d76afe4-9c39-43fd-affe-a2af42259a83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:05.109181 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.109141 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:05.109181 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.109188 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d76afe4-9c39-43fd-affe-a2af42259a83-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:05.109362 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.109198 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2rn6\" (UniqueName: \"kubernetes.io/projected/9d76afe4-9c39-43fd-affe-a2af42259a83-kube-api-access-p2rn6\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:05.884977 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.884955 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" Jun 11 17:53:05.885131 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.884948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5gbp9" event={"ID":"9d76afe4-9c39-43fd-affe-a2af42259a83","Type":"ContainerDied","Data":"1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148"} Jun 11 17:53:05.885131 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:05.885079 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1819c852c32a8455c869ed303f808fafb3ec184bc661168e49ee6456b9221148" Jun 11 17:53:11.165065 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165034 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js"] Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165373 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="util" Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165386 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="util" Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165397 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="extract" Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165403 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="extract" Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165413 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="pull" Jun 11 17:53:11.165449 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165419 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="pull" Jun 11 17:53:11.165630 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.165470 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d76afe4-9c39-43fd-affe-a2af42259a83" containerName="extract" Jun 11 17:53:11.167412 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.167398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.170161 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.170130 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:53:11.170310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.170213 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 17:53:11.170310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.170253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qt6n4\"" Jun 11 17:53:11.184192 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.181412 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js"] Jun 11 17:53:11.252889 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.252859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd5639-5ec6-451a-a03e-f1cccddc9e78-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.253000 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.252912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkmr\" (UniqueName: \"kubernetes.io/projected/41dd5639-5ec6-451a-a03e-f1cccddc9e78-kube-api-access-bhkmr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.353429 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.353395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkmr\" (UniqueName: \"kubernetes.io/projected/41dd5639-5ec6-451a-a03e-f1cccddc9e78-kube-api-access-bhkmr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.353604 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.353459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd5639-5ec6-451a-a03e-f1cccddc9e78-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.353778 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.353752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd5639-5ec6-451a-a03e-f1cccddc9e78-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.366611 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.366561 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkmr\" (UniqueName: \"kubernetes.io/projected/41dd5639-5ec6-451a-a03e-f1cccddc9e78-kube-api-access-bhkmr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-vr5js\" (UID: \"41dd5639-5ec6-451a-a03e-f1cccddc9e78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.477344 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.477315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" Jun 11 17:53:11.610774 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.610751 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js"] Jun 11 17:53:11.613086 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:11.613061 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41dd5639_5ec6_451a_a03e_f1cccddc9e78.slice/crio-58b9e9f4db6853d08bf1c12fa5301f02bf1c3379b11aa7a357966e99632fab7f WatchSource:0}: Error finding container 58b9e9f4db6853d08bf1c12fa5301f02bf1c3379b11aa7a357966e99632fab7f: Status 404 returned error can't find the container with id 58b9e9f4db6853d08bf1c12fa5301f02bf1c3379b11aa7a357966e99632fab7f Jun 11 17:53:11.909791 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:11.909710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" event={"ID":"41dd5639-5ec6-451a-a03e-f1cccddc9e78","Type":"ContainerStarted","Data":"58b9e9f4db6853d08bf1c12fa5301f02bf1c3379b11aa7a357966e99632fab7f"} Jun 11 17:53:13.923288 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:13.923211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" event={"ID":"41dd5639-5ec6-451a-a03e-f1cccddc9e78","Type":"ContainerStarted","Data":"655d40595dda6264471cfb3ebcfe7454243721daee73c7cc9d7f68fc5c60cc2e"} Jun 11 17:53:13.945214 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:13.945139 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-vr5js" podStartSLOduration=1.2278306429999999 podStartE2EDuration="2.94511891s" totalImagesPullingTime="1.717288267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:13.942575966 +0000 UTC m=+350.036669505" watchObservedRunningTime="2026-06-11 17:53:13.94511891 +0000 UTC m=+350.039212417" Jun 11 17:53:15.221785 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.221745 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n"] Jun 11 17:53:15.225524 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.225499 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.228675 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.228654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:53:15.228780 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.228711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:53:15.229660 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.229646 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:53:15.241470 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.241449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n"] Jun 11 17:53:15.287412 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.287385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.287546 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.287448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.287615 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.287595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6b2j\" (UniqueName: \"kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.388061 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.388026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.388240 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.388141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6b2j\" (UniqueName: \"kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.388240 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.388204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.388424 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.388402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.388531 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.388508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.403498 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.403466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6b2j\" (UniqueName: \"kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.534335 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.534263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:15.664106 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.664083 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n"] Jun 11 17:53:15.665757 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:15.665727 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386ae11b_3560_4468_91bf_edaad99c99c0.slice/crio-2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e WatchSource:0}: Error finding container 2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e: Status 404 returned error can't find the container with id 2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e Jun 11 17:53:15.932921 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.932846 2574 generic.go:356] "Generic (PLEG): container finished" podID="386ae11b-3560-4468-91bf-edaad99c99c0" containerID="060b941b3f5b66f78acac490dd79663d232e28ae2f581e154ddda913e0f8abd9" exitCode=0 Jun 11 17:53:15.933039 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.932932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" event={"ID":"386ae11b-3560-4468-91bf-edaad99c99c0","Type":"ContainerDied","Data":"060b941b3f5b66f78acac490dd79663d232e28ae2f581e154ddda913e0f8abd9"} Jun 11 17:53:15.933039 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:15.932982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" event={"ID":"386ae11b-3560-4468-91bf-edaad99c99c0","Type":"ContainerStarted","Data":"2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e"} Jun 11 17:53:19.451896 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.451866 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb"] Jun 11 17:53:19.455310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.455271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.457799 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.457774 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 17:53:19.457908 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.457886 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 17:53:19.458970 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.458950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pvlb8\"" Jun 11 17:53:19.463601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.463577 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb"] Jun 11 17:53:19.521384 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.521357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgh5h\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-kube-api-access-kgh5h\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.521518 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.521474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.622391 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.622357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgh5h\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-kube-api-access-kgh5h\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.622565 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.622487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.631142 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.631116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.631463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.631441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgh5h\" (UniqueName: \"kubernetes.io/projected/1b1e71a5-2bdf-4c24-92a7-31bac0906682-kube-api-access-kgh5h\") pod \"cert-manager-cainjector-5d99449ffd-b2hwb\" (UID: \"1b1e71a5-2bdf-4c24-92a7-31bac0906682\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:19.774877 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:19.774799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" Jun 11 17:53:20.586555 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:20.586524 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb"] Jun 11 17:53:20.589483 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:20.589457 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b1e71a5_2bdf_4c24_92a7_31bac0906682.slice/crio-25dc569bfb59ab5bfcc0a3e354713124a5532c17223df64f4fe66ca673ea57f4 WatchSource:0}: Error finding container 25dc569bfb59ab5bfcc0a3e354713124a5532c17223df64f4fe66ca673ea57f4: Status 404 returned error can't find the container with id 25dc569bfb59ab5bfcc0a3e354713124a5532c17223df64f4fe66ca673ea57f4 Jun 11 17:53:20.961078 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:20.961045 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" event={"ID":"1b1e71a5-2bdf-4c24-92a7-31bac0906682","Type":"ContainerStarted","Data":"25dc569bfb59ab5bfcc0a3e354713124a5532c17223df64f4fe66ca673ea57f4"} Jun 11 17:53:20.962860 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:20.962834 2574 generic.go:356] "Generic (PLEG): container finished" podID="386ae11b-3560-4468-91bf-edaad99c99c0" containerID="bed8a3a2158bd785314587a4b5bac3a1da3fbb505bacd220823b9f67833c8f87" exitCode=0 Jun 11 17:53:20.962987 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:20.962883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" event={"ID":"386ae11b-3560-4468-91bf-edaad99c99c0","Type":"ContainerDied","Data":"bed8a3a2158bd785314587a4b5bac3a1da3fbb505bacd220823b9f67833c8f87"} Jun 11 17:53:21.970435 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:21.970402 2574 generic.go:356] "Generic (PLEG): container finished" podID="386ae11b-3560-4468-91bf-edaad99c99c0" containerID="0ca325ad707df9f806bca88cc480063bea284b14f450302e63f1022a60ae7584" exitCode=0 Jun 11 17:53:21.970889 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:21.970464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" event={"ID":"386ae11b-3560-4468-91bf-edaad99c99c0","Type":"ContainerDied","Data":"0ca325ad707df9f806bca88cc480063bea284b14f450302e63f1022a60ae7584"} Jun 11 17:53:22.265271 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.265181 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2c58"] Jun 11 17:53:22.268678 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.268655 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.270975 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.270954 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9kwtk\"" Jun 11 17:53:22.275595 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.275568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2c58"] Jun 11 17:53:22.348643 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.348615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.348804 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.348666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngjz8\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-kube-api-access-ngjz8\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.449823 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.449792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngjz8\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-kube-api-access-ngjz8\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.449971 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.449890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.458367 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.458342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.458588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.458565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngjz8\" (UniqueName: \"kubernetes.io/projected/d815a8b6-bf57-4d75-b152-6b5a5c47203a-kube-api-access-ngjz8\") pod \"cert-manager-webhook-7dc76cbb94-d2c58\" (UID: \"d815a8b6-bf57-4d75-b152-6b5a5c47203a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:22.580750 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:22.580668 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:23.268229 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.268207 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:23.357489 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.357462 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util\") pod \"386ae11b-3560-4468-91bf-edaad99c99c0\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " Jun 11 17:53:23.357606 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.357515 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle\") pod \"386ae11b-3560-4468-91bf-edaad99c99c0\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " Jun 11 17:53:23.357606 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.357571 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6b2j\" (UniqueName: \"kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j\") pod \"386ae11b-3560-4468-91bf-edaad99c99c0\" (UID: \"386ae11b-3560-4468-91bf-edaad99c99c0\") " Jun 11 17:53:23.357898 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.357872 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle" (OuterVolumeSpecName: "bundle") pod "386ae11b-3560-4468-91bf-edaad99c99c0" (UID: "386ae11b-3560-4468-91bf-edaad99c99c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:23.359581 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.359557 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j" (OuterVolumeSpecName: "kube-api-access-v6b2j") pod "386ae11b-3560-4468-91bf-edaad99c99c0" (UID: "386ae11b-3560-4468-91bf-edaad99c99c0"). InnerVolumeSpecName "kube-api-access-v6b2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:53:23.362044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.362023 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util" (OuterVolumeSpecName: "util") pod "386ae11b-3560-4468-91bf-edaad99c99c0" (UID: "386ae11b-3560-4468-91bf-edaad99c99c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:23.371314 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.371294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d2c58"] Jun 11 17:53:23.373075 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:23.373051 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd815a8b6_bf57_4d75_b152_6b5a5c47203a.slice/crio-e2e51854ced839b385e367f0c68f0cff20b109ab3d1a783db7ca0405bea08d97 WatchSource:0}: Error finding container e2e51854ced839b385e367f0c68f0cff20b109ab3d1a783db7ca0405bea08d97: Status 404 returned error can't find the container with id e2e51854ced839b385e367f0c68f0cff20b109ab3d1a783db7ca0405bea08d97 Jun 11 17:53:23.458741 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.458707 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6b2j\" (UniqueName: \"kubernetes.io/projected/386ae11b-3560-4468-91bf-edaad99c99c0-kube-api-access-v6b2j\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:23.458741 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.458742 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:23.458912 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.458756 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386ae11b-3560-4468-91bf-edaad99c99c0-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:23.982220 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.982183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" event={"ID":"1b1e71a5-2bdf-4c24-92a7-31bac0906682","Type":"ContainerStarted","Data":"db71e8342cb12602b1f8b7e3442e74d402449da8e49306941e2fd54efb7c3e06"} Jun 11 17:53:23.983796 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.983767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" event={"ID":"d815a8b6-bf57-4d75-b152-6b5a5c47203a","Type":"ContainerStarted","Data":"f13b6aba4637cc50c17cf0e4acb84d681b1c5435d90cef90f7bd48bef1e55d74"} Jun 11 17:53:23.983931 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.983807 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:23.983931 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.983820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" event={"ID":"d815a8b6-bf57-4d75-b152-6b5a5c47203a","Type":"ContainerStarted","Data":"e2e51854ced839b385e367f0c68f0cff20b109ab3d1a783db7ca0405bea08d97"} Jun 11 17:53:23.985524 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.985503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" event={"ID":"386ae11b-3560-4468-91bf-edaad99c99c0","Type":"ContainerDied","Data":"2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e"} Jun 11 17:53:23.985619 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.985528 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjjk5n" Jun 11 17:53:23.985619 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.985544 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2305e447c7fb79194f61c41296de6843d0b76fcfed43f26bea6744345c5fd14e" Jun 11 17:53:23.998603 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:23.998561 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b2hwb" podStartSLOduration=2.275738958 podStartE2EDuration="4.998548489s" totalImagesPullingTime="2.722809531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:23.997254529 +0000 UTC m=+360.091348035" watchObservedRunningTime="2026-06-11 17:53:23.998548489 +0000 UTC m=+360.092641995" Jun 11 17:53:24.017103 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:24.017050 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" podStartSLOduration=2.017038716 podStartE2EDuration="2.017038716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:24.016308039 +0000 UTC m=+360.110401571" watchObservedRunningTime="2026-06-11 17:53:24.017038716 +0000 UTC m=+360.111132222" Jun 11 17:53:28.444269 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444226 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n"] Jun 11 17:53:28.444767 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444748 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="util" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444770 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="util" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444783 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="pull" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444791 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="pull" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444804 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="extract" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444812 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="extract" Jun 11 17:53:28.444907 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.444903 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="386ae11b-3560-4468-91bf-edaad99c99c0" containerName="extract" Jun 11 17:53:28.450105 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.450085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.452603 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.452571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:53:28.452708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.452673 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5jqtz\"" Jun 11 17:53:28.453806 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.453787 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 17:53:28.456764 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.456739 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n"] Jun 11 17:53:28.504733 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.504709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnsk\" (UniqueName: \"kubernetes.io/projected/caa77139-b42a-4271-90d9-130c50fcea6a-kube-api-access-wpnsk\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.504870 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.504763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caa77139-b42a-4271-90d9-130c50fcea6a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.606261 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.606218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnsk\" (UniqueName: \"kubernetes.io/projected/caa77139-b42a-4271-90d9-130c50fcea6a-kube-api-access-wpnsk\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.606425 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.606294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caa77139-b42a-4271-90d9-130c50fcea6a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.606725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.606703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caa77139-b42a-4271-90d9-130c50fcea6a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.617723 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.617697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnsk\" (UniqueName: \"kubernetes.io/projected/caa77139-b42a-4271-90d9-130c50fcea6a-kube-api-access-wpnsk\") pod \"openshift-lws-operator-fd8ccff4c-lkw7n\" (UID: \"caa77139-b42a-4271-90d9-130c50fcea6a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.760738 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.760644 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" Jun 11 17:53:28.891098 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:28.891075 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n"] Jun 11 17:53:28.892696 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:28.892668 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaa77139_b42a_4271_90d9_130c50fcea6a.slice/crio-70e7da5fd62c71fd0fc4fa5bb11086cfcfaee1cb13bdf1ae82f35df7d4149dec WatchSource:0}: Error finding container 70e7da5fd62c71fd0fc4fa5bb11086cfcfaee1cb13bdf1ae82f35df7d4149dec: Status 404 returned error can't find the container with id 70e7da5fd62c71fd0fc4fa5bb11086cfcfaee1cb13bdf1ae82f35df7d4149dec Jun 11 17:53:29.011335 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:29.011253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" event={"ID":"caa77139-b42a-4271-90d9-130c50fcea6a","Type":"ContainerStarted","Data":"70e7da5fd62c71fd0fc4fa5bb11086cfcfaee1cb13bdf1ae82f35df7d4149dec"} Jun 11 17:53:29.992141 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:29.992103 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d2c58" Jun 11 17:53:32.029793 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:32.029747 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" event={"ID":"caa77139-b42a-4271-90d9-130c50fcea6a","Type":"ContainerStarted","Data":"15bf49fad2bc0028c53b180996577cbca4406a6e4a55a80f0e07e1318f090730"} Jun 11 17:53:32.047040 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:32.046994 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkw7n" podStartSLOduration=1.939969306 podStartE2EDuration="4.046980797s" totalImagesPullingTime="2.107011491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:32.045100101 +0000 UTC m=+368.139193613" watchObservedRunningTime="2026-06-11 17:53:32.046980797 +0000 UTC m=+368.141074302" Jun 11 17:53:34.680288 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.680256 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g"] Jun 11 17:53:34.726970 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.726940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g"] Jun 11 17:53:34.727113 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.727034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.729849 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.729826 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:53:34.730778 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.730755 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:53:34.730887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.730788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:53:34.858127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.858089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.858320 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.858137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gchg\" (UniqueName: \"kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.858320 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.858237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.959588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.959557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gchg\" (UniqueName: \"kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.959750 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.959617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.959750 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.959662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.960007 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.959987 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.960075 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.959996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:34.967957 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:34.967932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gchg\" (UniqueName: \"kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:35.036156 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.036127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:35.182520 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.182491 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g"] Jun 11 17:53:35.184114 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:35.184083 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4634657_ac88_4602_a4dc_bd6d860d3ee2.slice/crio-03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134 WatchSource:0}: Error finding container 03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134: Status 404 returned error can't find the container with id 03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134 Jun 11 17:53:35.834771 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.834737 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-xgd57"] Jun 11 17:53:35.852043 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.852019 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xgd57"] Jun 11 17:53:35.852163 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.852102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:35.854936 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.854916 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kshmb\"" Jun 11 17:53:35.968470 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.968442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grgtf\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-kube-api-access-grgtf\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:35.968617 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:35.968490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-bound-sa-token\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.049483 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.049453 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerID="f11ebaf10fef5827c9a5343828ea5dad98ed526920a68c6d43914c506595916b" exitCode=0 Jun 11 17:53:36.049624 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.049509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerDied","Data":"f11ebaf10fef5827c9a5343828ea5dad98ed526920a68c6d43914c506595916b"} Jun 11 17:53:36.049624 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.049544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerStarted","Data":"03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134"} Jun 11 17:53:36.069928 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.069900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grgtf\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-kube-api-access-grgtf\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.070038 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.069949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-bound-sa-token\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.077748 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.077728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-bound-sa-token\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.077855 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.077792 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grgtf\" (UniqueName: \"kubernetes.io/projected/995a973a-54d9-46f2-88f8-f153fdbf5608-kube-api-access-grgtf\") pod \"cert-manager-59c77684cc-xgd57\" (UID: \"995a973a-54d9-46f2-88f8-f153fdbf5608\") " pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.161746 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.161675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xgd57" Jun 11 17:53:36.307225 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:36.307161 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xgd57"] Jun 11 17:53:36.309799 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:36.309767 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod995a973a_54d9_46f2_88f8_f153fdbf5608.slice/crio-f44d76c1b3379d373c693763355901af0272b9aaafe3cd63d342521af0da6da9 WatchSource:0}: Error finding container f44d76c1b3379d373c693763355901af0272b9aaafe3cd63d342521af0da6da9: Status 404 returned error can't find the container with id f44d76c1b3379d373c693763355901af0272b9aaafe3cd63d342521af0da6da9 Jun 11 17:53:37.056798 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:37.056770 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerStarted","Data":"2718e61166b77dfe3d85b94188171e5ee4f7bb74c15a6c60f8fe60a4f88ca17c"} Jun 11 17:53:37.058416 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:37.058390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xgd57" event={"ID":"995a973a-54d9-46f2-88f8-f153fdbf5608","Type":"ContainerStarted","Data":"400a7605fbcbf30027bcbfa924b232b518bf7b85cfffa867526937b204df4d1c"} Jun 11 17:53:37.058498 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:37.058426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xgd57" event={"ID":"995a973a-54d9-46f2-88f8-f153fdbf5608","Type":"ContainerStarted","Data":"f44d76c1b3379d373c693763355901af0272b9aaafe3cd63d342521af0da6da9"} Jun 11 17:53:37.090556 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:37.090517 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-xgd57" podStartSLOduration=2.090503161 podStartE2EDuration="2.090503161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:37.089235545 +0000 UTC m=+373.183329065" watchObservedRunningTime="2026-06-11 17:53:37.090503161 +0000 UTC m=+373.184596667" Jun 11 17:53:38.065824 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:38.065790 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerID="2718e61166b77dfe3d85b94188171e5ee4f7bb74c15a6c60f8fe60a4f88ca17c" exitCode=0 Jun 11 17:53:38.066194 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:38.065871 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerDied","Data":"2718e61166b77dfe3d85b94188171e5ee4f7bb74c15a6c60f8fe60a4f88ca17c"} Jun 11 17:53:39.075921 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:39.075886 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerID="d873ecb34d6bb89ec7e919de9b9b179bb0f9b1bafc3709218c05d06878e8d177" exitCode=0 Jun 11 17:53:39.076319 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:39.075963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerDied","Data":"d873ecb34d6bb89ec7e919de9b9b179bb0f9b1bafc3709218c05d06878e8d177"} Jun 11 17:53:40.207355 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.207332 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:40.305474 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.305445 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util\") pod \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " Jun 11 17:53:40.305637 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.305486 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gchg\" (UniqueName: \"kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg\") pod \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " Jun 11 17:53:40.305637 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.305544 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle\") pod \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\" (UID: \"c4634657-ac88-4602-a4dc-bd6d860d3ee2\") " Jun 11 17:53:40.306258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.306235 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle" (OuterVolumeSpecName: "bundle") pod "c4634657-ac88-4602-a4dc-bd6d860d3ee2" (UID: "c4634657-ac88-4602-a4dc-bd6d860d3ee2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:40.307578 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.307550 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg" (OuterVolumeSpecName: "kube-api-access-4gchg") pod "c4634657-ac88-4602-a4dc-bd6d860d3ee2" (UID: "c4634657-ac88-4602-a4dc-bd6d860d3ee2"). InnerVolumeSpecName "kube-api-access-4gchg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:53:40.311288 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.311254 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util" (OuterVolumeSpecName: "util") pod "c4634657-ac88-4602-a4dc-bd6d860d3ee2" (UID: "c4634657-ac88-4602-a4dc-bd6d860d3ee2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:53:40.406292 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.406262 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:40.406292 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.406287 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4634657-ac88-4602-a4dc-bd6d860d3ee2-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:40.406422 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:40.406301 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gchg\" (UniqueName: \"kubernetes.io/projected/c4634657-ac88-4602-a4dc-bd6d860d3ee2-kube-api-access-4gchg\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:53:41.087024 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:41.086989 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" Jun 11 17:53:41.087024 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:41.087014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsht9g" event={"ID":"c4634657-ac88-4602-a4dc-bd6d860d3ee2","Type":"ContainerDied","Data":"03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134"} Jun 11 17:53:41.087262 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:41.087060 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03d32032d096c15e26c45e54df084c3e08d1e78e0952c12bf3f7415ac95b3134" Jun 11 17:53:50.019824 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.019788 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd"] Jun 11 17:53:50.020320 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020301 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="extract" Jun 11 17:53:50.020397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020324 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="extract" Jun 11 17:53:50.020397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020339 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="pull" Jun 11 17:53:50.020397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020348 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="pull" Jun 11 17:53:50.020397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020365 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="util" Jun 11 17:53:50.020397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020373 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="util" Jun 11 17:53:50.020630 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.020472 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4634657-ac88-4602-a4dc-bd6d860d3ee2" containerName="extract" Jun 11 17:53:50.022623 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.022596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.026503 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.026477 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 17:53:50.026816 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.026779 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 17:53:50.026816 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.026805 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 17:53:50.026981 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.026823 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g8wrt\"" Jun 11 17:53:50.026981 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.026807 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 17:53:50.052430 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.052404 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd"] Jun 11 17:53:50.185766 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.185737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.185766 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.185769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.185985 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.185808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk862\" (UniqueName: \"kubernetes.io/projected/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-kube-api-access-hk862\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.185985 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.185848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-manifests\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.185985 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.185863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-tmp\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.286987 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.286893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk862\" (UniqueName: \"kubernetes.io/projected/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-kube-api-access-hk862\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.286987 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.286936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-manifests\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.286987 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.286961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-tmp\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.287304 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.287046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.287304 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.287071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.287418 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.287373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-manifests\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.289419 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.289395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-tmp\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.289553 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.289463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.289610 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.289553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.296023 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.295999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk862\" (UniqueName: \"kubernetes.io/projected/1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5-kube-api-access-hk862\") pod \"opendatahub-operator-controller-manager-bfd79d7d-lx7cd\" (UID: \"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5\") " pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.334902 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.334865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:50.485415 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:50.485393 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd"] Jun 11 17:53:50.487185 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:53:50.487143 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbb84c5_cfd1_4656_8cbf_5b03e4fb42a5.slice/crio-de465f53be93ce236abe4e39eb03df645d4fc483204046f222bdad975d6ac1ab WatchSource:0}: Error finding container de465f53be93ce236abe4e39eb03df645d4fc483204046f222bdad975d6ac1ab: Status 404 returned error can't find the container with id de465f53be93ce236abe4e39eb03df645d4fc483204046f222bdad975d6ac1ab Jun 11 17:53:51.145185 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:51.145126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" event={"ID":"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5","Type":"ContainerStarted","Data":"de465f53be93ce236abe4e39eb03df645d4fc483204046f222bdad975d6ac1ab"} Jun 11 17:53:54.163725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:54.163684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" event={"ID":"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5","Type":"ContainerStarted","Data":"b6f292778e753559b3916026f2986ecead4dc6b04e17b78f6d88b7cfbca64bc0"} Jun 11 17:53:55.169597 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:55.169562 2574 generic.go:356] "Generic (PLEG): container finished" podID="1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5" containerID="b6f292778e753559b3916026f2986ecead4dc6b04e17b78f6d88b7cfbca64bc0" exitCode=0 Jun 11 17:53:55.169981 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:55.169650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" event={"ID":"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5","Type":"ContainerDied","Data":"b6f292778e753559b3916026f2986ecead4dc6b04e17b78f6d88b7cfbca64bc0"} Jun 11 17:53:56.176666 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:56.176634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" event={"ID":"1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5","Type":"ContainerStarted","Data":"1353a59c7969690c342381f56c2b6ac602b12f11f26db8ea8f50de55c31e02cf"} Jun 11 17:53:56.177064 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:56.176735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:53:56.199703 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:53:56.199656 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" podStartSLOduration=2.744414911 podStartE2EDuration="7.199640789s" totalImagesPullingTime="3.510992336s" totalInitContainerRuntime="944.233542ms" isStatefulPod=false podCreationTimestamp="2026-06-11 17:53:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:53:56.196803954 +0000 UTC m=+392.290897462" watchObservedRunningTime="2026-06-11 17:53:56.199640789 +0000 UTC m=+392.293734294" Jun 11 17:54:07.184224 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:07.184196 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bfd79d7d-lx7cd" Jun 11 17:54:09.168634 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.168591 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh"] Jun 11 17:54:09.177368 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.177345 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.180331 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.180308 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 17:54:09.181353 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.181333 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5tmqb\"" Jun 11 17:54:09.181469 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.181360 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 17:54:09.181469 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.181372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 17:54:09.181469 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.181374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 17:54:09.193670 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.193647 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh"] Jun 11 17:54:09.239804 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.239774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vhb\" (UniqueName: \"kubernetes.io/projected/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-kube-api-access-99vhb\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.239956 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.239878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tmp\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.239956 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.239901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tls-certs\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.340730 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.340701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vhb\" (UniqueName: \"kubernetes.io/projected/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-kube-api-access-99vhb\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.340895 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.340775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tmp\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.340895 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.340795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tls-certs\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.343152 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.343128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tmp\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.343152 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.343150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-tls-certs\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.362442 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.362422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vhb\" (UniqueName: \"kubernetes.io/projected/d4fae104-1f92-4ca4-82ae-2318e1c50fd2-kube-api-access-99vhb\") pod \"kube-auth-proxy-ff7f75b64-ch2dh\" (UID: \"d4fae104-1f92-4ca4-82ae-2318e1c50fd2\") " pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.453338 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.453312 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-djh2s"] Jun 11 17:54:09.456753 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.456738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:09.459762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.459733 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 17:54:09.459941 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.459925 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-thq97\"" Jun 11 17:54:09.477460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.477436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-djh2s"] Jun 11 17:54:09.487460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.487441 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" Jun 11 17:54:09.542730 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.542691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkklm\" (UniqueName: \"kubernetes.io/projected/b5a275e5-c68f-4f7d-97e8-87647961e03a-kube-api-access-pkklm\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:09.542874 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.542784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:09.639734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.639702 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh"] Jun 11 17:54:09.642807 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:09.642773 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fae104_1f92_4ca4_82ae_2318e1c50fd2.slice/crio-5bbdd74fc335fd354814ca9a217d6661f383bd73cd03d25e345ac727ebc7a7ab WatchSource:0}: Error finding container 5bbdd74fc335fd354814ca9a217d6661f383bd73cd03d25e345ac727ebc7a7ab: Status 404 returned error can't find the container with id 5bbdd74fc335fd354814ca9a217d6661f383bd73cd03d25e345ac727ebc7a7ab Jun 11 17:54:09.643799 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.643771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:09.643898 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.643884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkklm\" (UniqueName: \"kubernetes.io/projected/b5a275e5-c68f-4f7d-97e8-87647961e03a-kube-api-access-pkklm\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:09.643941 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:54:09.643891 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 17:54:09.643988 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:54:09.643961 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert podName:b5a275e5-c68f-4f7d-97e8-87647961e03a nodeName:}" failed. No retries permitted until 2026-06-11 17:54:10.143941358 +0000 UTC m=+406.238034845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert") pod "odh-model-controller-6dc94f689f-djh2s" (UID: "b5a275e5-c68f-4f7d-97e8-87647961e03a") : secret "odh-model-controller-webhook-cert" not found Jun 11 17:54:09.664339 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:09.664316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkklm\" (UniqueName: \"kubernetes.io/projected/b5a275e5-c68f-4f7d-97e8-87647961e03a-kube-api-access-pkklm\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:10.147397 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.147363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:10.147548 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:54:10.147516 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 17:54:10.147611 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:54:10.147588 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert podName:b5a275e5-c68f-4f7d-97e8-87647961e03a nodeName:}" failed. No retries permitted until 2026-06-11 17:54:11.147572683 +0000 UTC m=+407.241666167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert") pod "odh-model-controller-6dc94f689f-djh2s" (UID: "b5a275e5-c68f-4f7d-97e8-87647961e03a") : secret "odh-model-controller-webhook-cert" not found Jun 11 17:54:10.245675 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.245644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" event={"ID":"d4fae104-1f92-4ca4-82ae-2318e1c50fd2","Type":"ContainerStarted","Data":"5bbdd74fc335fd354814ca9a217d6661f383bd73cd03d25e345ac727ebc7a7ab"} Jun 11 17:54:10.379137 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.379103 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2bdph"] Jun 11 17:54:10.383063 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.383042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.386300 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.385998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 17:54:10.390699 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.390644 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2bdph"] Jun 11 17:54:10.450163 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.450124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vd6z\" (UniqueName: \"kubernetes.io/projected/6c307435-4e51-4b4a-b246-f963b7919167-kube-api-access-8vd6z\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.450460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.450434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c307435-4e51-4b4a-b246-f963b7919167-tls-certs\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.551531 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.551491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vd6z\" (UniqueName: \"kubernetes.io/projected/6c307435-4e51-4b4a-b246-f963b7919167-kube-api-access-8vd6z\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.551703 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.551638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c307435-4e51-4b4a-b246-f963b7919167-tls-certs\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.554737 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.554712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c307435-4e51-4b4a-b246-f963b7919167-tls-certs\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.560127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.560083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vd6z\" (UniqueName: \"kubernetes.io/projected/6c307435-4e51-4b4a-b246-f963b7919167-kube-api-access-8vd6z\") pod \"model-serving-api-5dd488fc48-2bdph\" (UID: \"6c307435-4e51-4b4a-b246-f963b7919167\") " pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.699490 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.699443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:10.862732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:10.862704 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2bdph"] Jun 11 17:54:10.865205 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:10.865152 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c307435_4e51_4b4a_b246_f963b7919167.slice/crio-fe18c0938d0be4b99b705364f864aef5e9dc9927ceffb50058b000c087ef8012 WatchSource:0}: Error finding container fe18c0938d0be4b99b705364f864aef5e9dc9927ceffb50058b000c087ef8012: Status 404 returned error can't find the container with id fe18c0938d0be4b99b705364f864aef5e9dc9927ceffb50058b000c087ef8012 Jun 11 17:54:11.032515 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.032439 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq"] Jun 11 17:54:11.036221 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.036201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.038758 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.038737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:54:11.038758 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.038753 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:54:11.038933 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.038737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:54:11.044058 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.044000 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq"] Jun 11 17:54:11.057387 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.057359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.057477 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.057417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v57k\" (UniqueName: \"kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.057565 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.057547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.158281 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.158460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.158460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v57k\" (UniqueName: \"kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.158460 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:11.158727 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.158811 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.158755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.161579 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.161547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a275e5-c68f-4f7d-97e8-87647961e03a-cert\") pod \"odh-model-controller-6dc94f689f-djh2s\" (UID: \"b5a275e5-c68f-4f7d-97e8-87647961e03a\") " pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:11.166200 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.166158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v57k\" (UniqueName: \"kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.253360 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.253322 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" event={"ID":"6c307435-4e51-4b4a-b246-f963b7919167","Type":"ContainerStarted","Data":"fe18c0938d0be4b99b705364f864aef5e9dc9927ceffb50058b000c087ef8012"} Jun 11 17:54:11.266893 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.266855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:11.350813 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.349559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:11.946416 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.946003 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-djh2s"] Jun 11 17:54:11.968156 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:11.968131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq"] Jun 11 17:54:12.557004 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:12.556971 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a275e5_c68f_4f7d_97e8_87647961e03a.slice/crio-fdd798953410148f8a3aa59f6a59a27777c3cef18c3cb911e87ffb51a8c6a6e6 WatchSource:0}: Error finding container fdd798953410148f8a3aa59f6a59a27777c3cef18c3cb911e87ffb51a8c6a6e6: Status 404 returned error can't find the container with id fdd798953410148f8a3aa59f6a59a27777c3cef18c3cb911e87ffb51a8c6a6e6 Jun 11 17:54:12.557862 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:12.557833 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1004fc07_bedf_47b3_8228_274c1fb657d9.slice/crio-e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b WatchSource:0}: Error finding container e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b: Status 404 returned error can't find the container with id e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b Jun 11 17:54:13.268498 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.268458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" event={"ID":"d4fae104-1f92-4ca4-82ae-2318e1c50fd2","Type":"ContainerStarted","Data":"10dd0f2b53185f910a99952bf80e849377dd661ef79f2beface8d3818c50ee78"} Jun 11 17:54:13.271112 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.271079 2574 generic.go:356] "Generic (PLEG): container finished" podID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerID="9971469d6efcc612abe4e2eb1bc56646a01b84e487f51567bcbf5e9d0d1cfefd" exitCode=0 Jun 11 17:54:13.271281 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.271160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerDied","Data":"9971469d6efcc612abe4e2eb1bc56646a01b84e487f51567bcbf5e9d0d1cfefd"} Jun 11 17:54:13.271281 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.271235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerStarted","Data":"e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b"} Jun 11 17:54:13.273140 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.273110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" event={"ID":"b5a275e5-c68f-4f7d-97e8-87647961e03a","Type":"ContainerStarted","Data":"fdd798953410148f8a3aa59f6a59a27777c3cef18c3cb911e87ffb51a8c6a6e6"} Jun 11 17:54:13.286851 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:13.286780 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ff7f75b64-ch2dh" podStartSLOduration=1.3153093949999999 podStartE2EDuration="4.286762032s" totalImagesPullingTime="2.971452637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:13.284715155 +0000 UTC m=+409.378808662" watchObservedRunningTime="2026-06-11 17:54:13.286762032 +0000 UTC m=+409.380855535" Jun 11 17:54:14.281650 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:14.281566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" event={"ID":"6c307435-4e51-4b4a-b246-f963b7919167","Type":"ContainerStarted","Data":"3982f3793479c48e0bcd617d4a17545339f2304595bc5839708dfcef6c7d2d2d"} Jun 11 17:54:14.282082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:14.281676 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:14.299310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:14.299266 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" podStartSLOduration=1.8577848750000001 podStartE2EDuration="4.299252376s" totalImagesPullingTime="2.441467501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:14.296954842 +0000 UTC m=+410.391048351" watchObservedRunningTime="2026-06-11 17:54:14.299252376 +0000 UTC m=+410.393345882" Jun 11 17:54:15.289436 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:15.289401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerStarted","Data":"61a33d9f98b29b7a3e8e1977054c3694891e32cb554f738a85216567175aec3a"} Jun 11 17:54:16.302239 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:16.302192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" event={"ID":"b5a275e5-c68f-4f7d-97e8-87647961e03a","Type":"ContainerStarted","Data":"1fcc4133b44e29829f4c635e5ad8a555b0db1b0132a6aa3fc51dd2cdf847c35e"} Jun 11 17:54:16.302689 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:16.302294 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:16.303964 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:16.303939 2574 generic.go:356] "Generic (PLEG): container finished" podID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerID="61a33d9f98b29b7a3e8e1977054c3694891e32cb554f738a85216567175aec3a" exitCode=0 Jun 11 17:54:16.304062 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:16.303988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerDied","Data":"61a33d9f98b29b7a3e8e1977054c3694891e32cb554f738a85216567175aec3a"} Jun 11 17:54:16.335399 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:16.335345 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" podStartSLOduration=4.401207138 podStartE2EDuration="7.335329023s" totalImagesPullingTime="2.934121885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:16.333977308 +0000 UTC m=+412.428070816" watchObservedRunningTime="2026-06-11 17:54:16.335329023 +0000 UTC m=+412.429422528" Jun 11 17:54:17.310762 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:17.310728 2574 generic.go:356] "Generic (PLEG): container finished" podID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerID="891737e43b705e3369f52b6d30b5d68d35c69c7f53e8a6c6bfd7fce8e4cf5864" exitCode=0 Jun 11 17:54:17.311199 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:17.310815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerDied","Data":"891737e43b705e3369f52b6d30b5d68d35c69c7f53e8a6c6bfd7fce8e4cf5864"} Jun 11 17:54:18.462295 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.462270 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:18.526909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.524425 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle\") pod \"1004fc07-bedf-47b3-8228-274c1fb657d9\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " Jun 11 17:54:18.526909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.524502 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v57k\" (UniqueName: \"kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k\") pod \"1004fc07-bedf-47b3-8228-274c1fb657d9\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " Jun 11 17:54:18.526909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.524539 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util\") pod \"1004fc07-bedf-47b3-8228-274c1fb657d9\" (UID: \"1004fc07-bedf-47b3-8228-274c1fb657d9\") " Jun 11 17:54:18.526909 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.526234 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle" (OuterVolumeSpecName: "bundle") pod "1004fc07-bedf-47b3-8228-274c1fb657d9" (UID: "1004fc07-bedf-47b3-8228-274c1fb657d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:54:18.529058 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.529026 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k" (OuterVolumeSpecName: "kube-api-access-2v57k") pod "1004fc07-bedf-47b3-8228-274c1fb657d9" (UID: "1004fc07-bedf-47b3-8228-274c1fb657d9"). InnerVolumeSpecName "kube-api-access-2v57k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:54:18.532257 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.532086 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util" (OuterVolumeSpecName: "util") pod "1004fc07-bedf-47b3-8228-274c1fb657d9" (UID: "1004fc07-bedf-47b3-8228-274c1fb657d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:54:18.625941 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.625873 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:18.625941 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.625908 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v57k\" (UniqueName: \"kubernetes.io/projected/1004fc07-bedf-47b3-8228-274c1fb657d9-kube-api-access-2v57k\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:18.625941 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:18.625924 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1004fc07-bedf-47b3-8228-274c1fb657d9-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:19.324858 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.324832 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" Jun 11 17:54:19.325034 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.324863 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qq9kq" event={"ID":"1004fc07-bedf-47b3-8228-274c1fb657d9","Type":"ContainerDied","Data":"e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b"} Jun 11 17:54:19.325034 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.324906 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e39d33cce6e0073e3fef201fe21f3b9909ea07b3a0572573ceac49e61511943b" Jun 11 17:54:19.595856 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.595768 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8gkfp"] Jun 11 17:54:19.596344 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596325 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="util" Jun 11 17:54:19.596413 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596347 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="util" Jun 11 17:54:19.596413 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596381 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="extract" Jun 11 17:54:19.596413 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596392 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="extract" Jun 11 17:54:19.596555 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596419 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="pull" Jun 11 17:54:19.596555 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596429 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="pull" Jun 11 17:54:19.596555 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.596524 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1004fc07-bedf-47b3-8228-274c1fb657d9" containerName="extract" Jun 11 17:54:19.602433 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.602411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.605868 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.605827 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fg7jb\"" Jun 11 17:54:19.606217 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.606165 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 17:54:19.609702 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.609387 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8gkfp"] Jun 11 17:54:19.620229 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.620205 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k"] Jun 11 17:54:19.624184 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.624159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.627479 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.627462 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 17:54:19.627627 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.627611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b2lhq\"" Jun 11 17:54:19.634820 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.634800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l86z\" (UniqueName: \"kubernetes.io/projected/fb3cad0a-cf20-429f-befe-9af3b217eee1-kube-api-access-9l86z\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.634894 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.634845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3cad0a-cf20-429f-befe-9af3b217eee1-cert\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.638481 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.638460 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k"] Jun 11 17:54:19.735570 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.735541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c08aa41-962b-4f0b-918d-297933470d4b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.735787 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.735586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3cad0a-cf20-429f-befe-9af3b217eee1-cert\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.735787 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.735611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swt22\" (UniqueName: \"kubernetes.io/projected/0c08aa41-962b-4f0b-918d-297933470d4b-kube-api-access-swt22\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.735787 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.735719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l86z\" (UniqueName: \"kubernetes.io/projected/fb3cad0a-cf20-429f-befe-9af3b217eee1-kube-api-access-9l86z\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.743725 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.743699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3cad0a-cf20-429f-befe-9af3b217eee1-cert\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.744535 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.744516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l86z\" (UniqueName: \"kubernetes.io/projected/fb3cad0a-cf20-429f-befe-9af3b217eee1-kube-api-access-9l86z\") pod \"kserve-controller-manager-69fc866d76-8gkfp\" (UID: \"fb3cad0a-cf20-429f-befe-9af3b217eee1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.836350 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.836324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c08aa41-962b-4f0b-918d-297933470d4b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.836480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.836371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swt22\" (UniqueName: \"kubernetes.io/projected/0c08aa41-962b-4f0b-918d-297933470d4b-kube-api-access-swt22\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.838591 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.838564 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c08aa41-962b-4f0b-918d-297933470d4b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.850091 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.850030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swt22\" (UniqueName: \"kubernetes.io/projected/0c08aa41-962b-4f0b-918d-297933470d4b-kube-api-access-swt22\") pod \"llmisvc-controller-manager-864bfd7bc9-gtn7k\" (UID: \"0c08aa41-962b-4f0b-918d-297933470d4b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:19.913568 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.913547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:19.934405 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:19.934380 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:20.066451 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:20.066416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8gkfp"] Jun 11 17:54:20.067855 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:20.067823 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3cad0a_cf20_429f_befe_9af3b217eee1.slice/crio-2bf161424816804d832a6bc1a9730e10915d7d1d0d57497e39e8a9cf4668ec8f WatchSource:0}: Error finding container 2bf161424816804d832a6bc1a9730e10915d7d1d0d57497e39e8a9cf4668ec8f: Status 404 returned error can't find the container with id 2bf161424816804d832a6bc1a9730e10915d7d1d0d57497e39e8a9cf4668ec8f Jun 11 17:54:20.094316 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:20.094294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k"] Jun 11 17:54:20.095964 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:20.095939 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0c08aa41_962b_4f0b_918d_297933470d4b.slice/crio-21bc6a1375067a09ab2d19fb56aa6184cd16d2f97a684f2397c675601586df23 WatchSource:0}: Error finding container 21bc6a1375067a09ab2d19fb56aa6184cd16d2f97a684f2397c675601586df23: Status 404 returned error can't find the container with id 21bc6a1375067a09ab2d19fb56aa6184cd16d2f97a684f2397c675601586df23 Jun 11 17:54:20.332832 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:20.332792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" event={"ID":"0c08aa41-962b-4f0b-918d-297933470d4b","Type":"ContainerStarted","Data":"21bc6a1375067a09ab2d19fb56aa6184cd16d2f97a684f2397c675601586df23"} Jun 11 17:54:20.334734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:20.334485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" event={"ID":"fb3cad0a-cf20-429f-befe-9af3b217eee1","Type":"ContainerStarted","Data":"2bf161424816804d832a6bc1a9730e10915d7d1d0d57497e39e8a9cf4668ec8f"} Jun 11 17:54:23.355400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:23.355362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" event={"ID":"fb3cad0a-cf20-429f-befe-9af3b217eee1","Type":"ContainerStarted","Data":"5665f819c93de593e49b224aeace6edf696d4196d5d122ce693018f9d0d5210c"} Jun 11 17:54:23.355869 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:23.355453 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:23.374410 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:23.374360 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" podStartSLOduration=1.7924482830000001 podStartE2EDuration="4.374340213s" totalImagesPullingTime="2.58189193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:23.373933651 +0000 UTC m=+419.468027158" watchObservedRunningTime="2026-06-11 17:54:23.374340213 +0000 UTC m=+419.468433718" Jun 11 17:54:24.362328 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:24.362296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" event={"ID":"0c08aa41-962b-4f0b-918d-297933470d4b","Type":"ContainerStarted","Data":"ad28f9ca526d487a18f52a1966bf5d53362effcf36dd40d5858871bd52d157b5"} Jun 11 17:54:24.362727 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:24.362378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:24.381964 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:24.381917 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" podStartSLOduration=1.8777590750000002 podStartE2EDuration="5.381902757s" totalImagesPullingTime="3.504143682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:24.380681569 +0000 UTC m=+420.474775094" watchObservedRunningTime="2026-06-11 17:54:24.381902757 +0000 UTC m=+420.475996263" Jun 11 17:54:25.294118 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:25.294087 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-2bdph" Jun 11 17:54:26.389124 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.389093 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5"] Jun 11 17:54:26.492013 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.491945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5"] Jun 11 17:54:26.492285 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.492070 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.496350 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.496307 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:54:26.497311 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.497288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:54:26.497630 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.497594 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:54:26.607481 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.607449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7msc4\" (UniqueName: \"kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.607481 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.607482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.607685 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.607511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.708852 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.708816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.709010 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.708910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7msc4\" (UniqueName: \"kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.709010 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.708931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.709297 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.709274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.709344 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.709279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.717865 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.717842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7msc4\" (UniqueName: \"kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.805929 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.805889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:26.966511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:26.966484 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5"] Jun 11 17:54:26.970093 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:26.970058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672b7037_a379_4e04_bf8a_92e104afdab6.slice/crio-0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de WatchSource:0}: Error finding container 0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de: Status 404 returned error can't find the container with id 0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de Jun 11 17:54:27.313215 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:27.313107 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-djh2s" Jun 11 17:54:27.383498 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:27.383466 2574 generic.go:356] "Generic (PLEG): container finished" podID="672b7037-a379-4e04-bf8a-92e104afdab6" containerID="95a23bf7aa412d23f0b17923d455e2b6696414b561dcbb86abd7e49bbe83a78f" exitCode=0 Jun 11 17:54:27.383663 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:27.383540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" event={"ID":"672b7037-a379-4e04-bf8a-92e104afdab6","Type":"ContainerDied","Data":"95a23bf7aa412d23f0b17923d455e2b6696414b561dcbb86abd7e49bbe83a78f"} Jun 11 17:54:27.383663 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:27.383588 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" event={"ID":"672b7037-a379-4e04-bf8a-92e104afdab6","Type":"ContainerStarted","Data":"0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de"} Jun 11 17:54:29.401369 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:29.401329 2574 generic.go:356] "Generic (PLEG): container finished" podID="672b7037-a379-4e04-bf8a-92e104afdab6" containerID="8f2d1ac626ac8eb6c66f630201ab34eab52107973fc35b0a89b545fa552280a1" exitCode=0 Jun 11 17:54:29.401802 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:29.401412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" event={"ID":"672b7037-a379-4e04-bf8a-92e104afdab6","Type":"ContainerDied","Data":"8f2d1ac626ac8eb6c66f630201ab34eab52107973fc35b0a89b545fa552280a1"} Jun 11 17:54:30.408653 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:30.408617 2574 generic.go:356] "Generic (PLEG): container finished" podID="672b7037-a379-4e04-bf8a-92e104afdab6" containerID="229bc56853837ab95b88cb6dad5573c200b584e752d42371913a9e9619e36d0f" exitCode=0 Jun 11 17:54:30.409011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:30.408703 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" event={"ID":"672b7037-a379-4e04-bf8a-92e104afdab6","Type":"ContainerDied","Data":"229bc56853837ab95b88cb6dad5573c200b584e752d42371913a9e9619e36d0f"} Jun 11 17:54:31.546213 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.546191 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:31.652985 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.652957 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util\") pod \"672b7037-a379-4e04-bf8a-92e104afdab6\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " Jun 11 17:54:31.653156 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.653012 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle\") pod \"672b7037-a379-4e04-bf8a-92e104afdab6\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " Jun 11 17:54:31.653156 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.653083 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7msc4\" (UniqueName: \"kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4\") pod \"672b7037-a379-4e04-bf8a-92e104afdab6\" (UID: \"672b7037-a379-4e04-bf8a-92e104afdab6\") " Jun 11 17:54:31.653910 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.653881 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle" (OuterVolumeSpecName: "bundle") pod "672b7037-a379-4e04-bf8a-92e104afdab6" (UID: "672b7037-a379-4e04-bf8a-92e104afdab6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:54:31.655130 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.655102 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4" (OuterVolumeSpecName: "kube-api-access-7msc4") pod "672b7037-a379-4e04-bf8a-92e104afdab6" (UID: "672b7037-a379-4e04-bf8a-92e104afdab6"). InnerVolumeSpecName "kube-api-access-7msc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:54:31.658425 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.658406 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util" (OuterVolumeSpecName: "util") pod "672b7037-a379-4e04-bf8a-92e104afdab6" (UID: "672b7037-a379-4e04-bf8a-92e104afdab6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:54:31.754311 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.754288 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:31.754311 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.754310 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672b7037-a379-4e04-bf8a-92e104afdab6-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:31.754438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:31.754320 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7msc4\" (UniqueName: \"kubernetes.io/projected/672b7037-a379-4e04-bf8a-92e104afdab6-kube-api-access-7msc4\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:54:32.420448 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:32.420423 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" Jun 11 17:54:32.420601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:32.420466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2rpx5" event={"ID":"672b7037-a379-4e04-bf8a-92e104afdab6","Type":"ContainerDied","Data":"0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de"} Jun 11 17:54:32.420601 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:32.420510 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0be87744c17cd1573b38931353aecff43aef65da53d7fecfcce46c980c8999de" Jun 11 17:54:39.432031 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.431985 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7986cb5f7-lg9bv"] Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432419 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="pull" Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432431 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="pull" Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432444 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="util" Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432449 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="util" Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432466 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="extract" Jun 11 17:54:39.432480 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432471 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="extract" Jun 11 17:54:39.432669 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.432528 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="672b7037-a379-4e04-bf8a-92e104afdab6" containerName="extract" Jun 11 17:54:39.434771 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.434750 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.437413 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.437389 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jg56h\"" Jun 11 17:54:39.437413 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.437401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 17:54:39.443783 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.443758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7986cb5f7-lg9bv"] Jun 11 17:54:39.524469 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.524435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwcv\" (UniqueName: \"kubernetes.io/projected/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-kube-api-access-bdwcv\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.524630 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.524502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-redirect-config\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.625011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.624972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwcv\" (UniqueName: \"kubernetes.io/projected/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-kube-api-access-bdwcv\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.625011 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.625013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-redirect-config\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.625716 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.625696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-redirect-config\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.636922 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.636897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwcv\" (UniqueName: \"kubernetes.io/projected/5c1dc3fb-6eb1-4833-80aa-e85f5bc32636-kube-api-access-bdwcv\") pod \"dashboard-redirect-7986cb5f7-lg9bv\" (UID: \"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636\") " pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.746378 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.746346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" Jun 11 17:54:39.902511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:39.902485 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7986cb5f7-lg9bv"] Jun 11 17:54:39.904594 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:39.904560 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1dc3fb_6eb1_4833_80aa_e85f5bc32636.slice/crio-9189404c04fbe312a291e5bdfe1170f6b616cd16e3059af04a650aeeab23058a WatchSource:0}: Error finding container 9189404c04fbe312a291e5bdfe1170f6b616cd16e3059af04a650aeeab23058a: Status 404 returned error can't find the container with id 9189404c04fbe312a291e5bdfe1170f6b616cd16e3059af04a650aeeab23058a Jun 11 17:54:40.468702 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:40.468660 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" event={"ID":"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636","Type":"ContainerStarted","Data":"9189404c04fbe312a291e5bdfe1170f6b616cd16e3059af04a650aeeab23058a"} Jun 11 17:54:42.482428 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:42.482394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" event={"ID":"5c1dc3fb-6eb1-4833-80aa-e85f5bc32636","Type":"ContainerStarted","Data":"05170e0f4a29323c3f1f69113e4df47986c8518aa45759d82965b48a1a9a685b"} Jun 11 17:54:42.501148 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:42.501085 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7986cb5f7-lg9bv" podStartSLOduration=1.88646535 podStartE2EDuration="3.501067638s" totalImagesPullingTime="1.614602288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:54:42.500692469 +0000 UTC m=+438.594785975" watchObservedRunningTime="2026-06-11 17:54:42.501067638 +0000 UTC m=+438.595161147" Jun 11 17:54:54.367905 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:54.367829 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8gkfp" Jun 11 17:54:55.370257 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:55.370227 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gtn7k" Jun 11 17:54:58.090321 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.090285 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk"] Jun 11 17:54:58.095066 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.095046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.097992 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.097967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 17:54:58.097992 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.097984 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 17:54:58.098186 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.097995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 17:54:58.098186 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.098036 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zj85d\"" Jun 11 17:54:58.098186 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.098072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 17:54:58.107630 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.107601 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk"] Jun 11 17:54:58.189955 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.189925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.189955 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.189957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.190127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.189980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586add5b-cdc5-41bd-a75a-84699a96fe31-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.190127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.190071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzjc\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-kube-api-access-4gzjc\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.190127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.190108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.190127 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.190124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.190291 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.190246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.290840 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzjc\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-kube-api-access-4gzjc\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.290974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291006 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.291003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586add5b-cdc5-41bd-a75a-84699a96fe31-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.291661 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.291608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.293312 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.293284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586add5b-cdc5-41bd-a75a-84699a96fe31-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.293407 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.293321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.293606 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.293589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.293678 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.293655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586add5b-cdc5-41bd-a75a-84699a96fe31-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.299112 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.299091 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzjc\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-kube-api-access-4gzjc\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.299255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.299234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586add5b-cdc5-41bd-a75a-84699a96fe31-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-tc8vk\" (UID: \"586add5b-cdc5-41bd-a75a-84699a96fe31\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.405237 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.405156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:54:58.535972 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.535940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk"] Jun 11 17:54:58.537048 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:54:58.537012 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586add5b_cdc5_41bd_a75a_84699a96fe31.slice/crio-06cd2ea96c7b3a9d1e581927ee5ec2469f2ce931e9936fc71509bd342c1e7b58 WatchSource:0}: Error finding container 06cd2ea96c7b3a9d1e581927ee5ec2469f2ce931e9936fc71509bd342c1e7b58: Status 404 returned error can't find the container with id 06cd2ea96c7b3a9d1e581927ee5ec2469f2ce931e9936fc71509bd342c1e7b58 Jun 11 17:54:58.569616 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:54:58.569589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" event={"ID":"586add5b-cdc5-41bd-a75a-84699a96fe31","Type":"ContainerStarted","Data":"06cd2ea96c7b3a9d1e581927ee5ec2469f2ce931e9936fc71509bd342c1e7b58"} Jun 11 17:55:01.907376 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:01.907337 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 17:55:01.907653 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:01.907409 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 17:55:02.597487 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:02.597449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" event={"ID":"586add5b-cdc5-41bd-a75a-84699a96fe31","Type":"ContainerStarted","Data":"d905237ff21b1b854838f694999225a238594b7b029b1bc28dc9d16676faa199"} Jun 11 17:55:02.597807 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:02.597768 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:55:02.599728 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:02.599695 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-tc8vk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 17:55:02.599868 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:02.599838 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" podUID="586add5b-cdc5-41bd-a75a-84699a96fe31" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 17:55:02.622254 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:02.622196 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" podStartSLOduration=1.25412356 podStartE2EDuration="4.622181319s" totalImagesPullingTime="3.368057759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:55:02.619802871 +0000 UTC m=+458.713896398" watchObservedRunningTime="2026-06-11 17:55:02.622181319 +0000 UTC m=+458.716274816" Jun 11 17:55:03.603638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:03.603606 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-tc8vk" Jun 11 17:55:25.858042 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.858006 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m"] Jun 11 17:55:25.861755 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.861737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:25.864373 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.864345 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 17:55:25.864373 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.864359 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 17:55:25.865676 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.865642 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bqzt6\"" Jun 11 17:55:25.868596 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.868576 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m"] Jun 11 17:55:25.943506 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.943478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ndw\" (UniqueName: \"kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:25.943652 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.943592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:25.943652 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:25.943641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.044732 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.044701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.044876 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.044748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.044876 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.044800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ndw\" (UniqueName: \"kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.045096 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.045073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.045250 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.045122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.062669 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.062644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ndw\" (UniqueName: \"kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.172087 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.172027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:26.304374 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.304346 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m"] Jun 11 17:55:26.307166 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:26.307141 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a64f8d_04c8_42a8_9c43_bc6b625eaaf3.slice/crio-c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906 WatchSource:0}: Error finding container c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906: Status 404 returned error can't find the container with id c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906 Jun 11 17:55:26.659060 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.659026 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67"] Jun 11 17:55:26.663093 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.663064 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.665790 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.665761 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67"] Jun 11 17:55:26.727792 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.727761 2574 generic.go:356] "Generic (PLEG): container finished" podID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerID="fc6d29e9b2ca6506d4c13bae76ee96f799c94331adde14e9cf182168be6b3a51" exitCode=0 Jun 11 17:55:26.727943 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.727851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" event={"ID":"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3","Type":"ContainerDied","Data":"fc6d29e9b2ca6506d4c13bae76ee96f799c94331adde14e9cf182168be6b3a51"} Jun 11 17:55:26.727943 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.727899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" event={"ID":"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3","Type":"ContainerStarted","Data":"c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906"} Jun 11 17:55:26.751332 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.751291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.751472 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.751360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.751472 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.751440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtmm\" (UniqueName: \"kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.851949 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.851917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.852094 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.851977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.852094 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.852037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtmm\" (UniqueName: \"kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.852385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.852365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.852429 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.852408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.860729 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.860705 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtmm\" (UniqueName: \"kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:26.974096 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:26.974074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:27.054250 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.054220 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq"] Jun 11 17:55:27.059057 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.059032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.066026 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.066000 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq"] Jun 11 17:55:27.111924 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.111899 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67"] Jun 11 17:55:27.112849 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:27.112823 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588a62d7_ba86_4d2f_861e_31fcd6b34de8.slice/crio-86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754 WatchSource:0}: Error finding container 86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754: Status 404 returned error can't find the container with id 86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754 Jun 11 17:55:27.155307 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.155283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.155412 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.155317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcxqq\" (UniqueName: \"kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.155412 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.155348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.256502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.256441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.256502 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.256482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcxqq\" (UniqueName: \"kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.256691 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.256519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.256887 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.256866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.256927 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.256890 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.264296 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.264274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcxqq\" (UniqueName: \"kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.385621 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.385586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:27.454000 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.453973 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7"] Jun 11 17:55:27.458892 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.458873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.464884 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.464862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7"] Jun 11 17:55:27.534675 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.534653 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq"] Jun 11 17:55:27.558952 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.558922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.559036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.558956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w7pt\" (UniqueName: \"kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.559096 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.559077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.562956 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:27.562937 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21670ca2_e4ff_45b9_89bc_6ec2540b6025.slice/crio-5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3 WatchSource:0}: Error finding container 5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3: Status 404 returned error can't find the container with id 5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3 Jun 11 17:55:27.659745 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.659718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.659871 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.659783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.659871 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.659805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w7pt\" (UniqueName: \"kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.660078 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.660058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.660208 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.660163 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.667964 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.667938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w7pt\" (UniqueName: \"kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.735438 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.735404 2574 generic.go:356] "Generic (PLEG): container finished" podID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerID="41f7b2c8b905cbbceec4f7d6dc9fc27fb6c2bcdec88fcad9db4bd4af64c37263" exitCode=0 Jun 11 17:55:27.735524 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.735487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" event={"ID":"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3","Type":"ContainerDied","Data":"41f7b2c8b905cbbceec4f7d6dc9fc27fb6c2bcdec88fcad9db4bd4af64c37263"} Jun 11 17:55:27.737024 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.737001 2574 generic.go:356] "Generic (PLEG): container finished" podID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerID="3f59bdda65931ca136720f43052f51974cdf6567fb1ae3c7bd6d7a735b54f773" exitCode=0 Jun 11 17:55:27.737100 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.737083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" event={"ID":"21670ca2-e4ff-45b9-89bc-6ec2540b6025","Type":"ContainerDied","Data":"3f59bdda65931ca136720f43052f51974cdf6567fb1ae3c7bd6d7a735b54f773"} Jun 11 17:55:27.737161 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.737125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" event={"ID":"21670ca2-e4ff-45b9-89bc-6ec2540b6025","Type":"ContainerStarted","Data":"5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3"} Jun 11 17:55:27.738589 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.738561 2574 generic.go:356] "Generic (PLEG): container finished" podID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerID="595cc8288364917b16d50049e002abcbe93ade49ee24ac4aa563fe6c80d7f331" exitCode=0 Jun 11 17:55:27.738682 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.738655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" event={"ID":"588a62d7-ba86-4d2f-861e-31fcd6b34de8","Type":"ContainerDied","Data":"595cc8288364917b16d50049e002abcbe93ade49ee24ac4aa563fe6c80d7f331"} Jun 11 17:55:27.738733 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.738702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" event={"ID":"588a62d7-ba86-4d2f-861e-31fcd6b34de8","Type":"ContainerStarted","Data":"86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754"} Jun 11 17:55:27.778832 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.778785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:27.915059 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:27.915035 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7"] Jun 11 17:55:27.930009 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:27.929981 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1357cefe_dd7e_4f85_9020_7dd141e0b5df.slice/crio-6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b WatchSource:0}: Error finding container 6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b: Status 404 returned error can't find the container with id 6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b Jun 11 17:55:28.746617 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.746585 2574 generic.go:356] "Generic (PLEG): container finished" podID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerID="1e84efd78731823a0670274fb47eb725a3e4d3b7d2c14590384fbec0ce413c99" exitCode=0 Jun 11 17:55:28.746734 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.746630 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" event={"ID":"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3","Type":"ContainerDied","Data":"1e84efd78731823a0670274fb47eb725a3e4d3b7d2c14590384fbec0ce413c99"} Jun 11 17:55:28.748068 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.748051 2574 generic.go:356] "Generic (PLEG): container finished" podID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerID="604057c8dad54dc14b665cfa65bfc1aab11a2eed136be213e85649e4b98c21b5" exitCode=0 Jun 11 17:55:28.748192 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.748124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" event={"ID":"1357cefe-dd7e-4f85-9020-7dd141e0b5df","Type":"ContainerDied","Data":"604057c8dad54dc14b665cfa65bfc1aab11a2eed136be213e85649e4b98c21b5"} Jun 11 17:55:28.748192 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.748159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" event={"ID":"1357cefe-dd7e-4f85-9020-7dd141e0b5df","Type":"ContainerStarted","Data":"6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b"} Jun 11 17:55:28.749899 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.749879 2574 generic.go:356] "Generic (PLEG): container finished" podID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerID="f4d36d25e6b12288944f198079b5c582d5fde5abafbc8d03dbc13308a6f7c8a0" exitCode=0 Jun 11 17:55:28.750009 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.749909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" event={"ID":"21670ca2-e4ff-45b9-89bc-6ec2540b6025","Type":"ContainerDied","Data":"f4d36d25e6b12288944f198079b5c582d5fde5abafbc8d03dbc13308a6f7c8a0"} Jun 11 17:55:28.751835 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.751815 2574 generic.go:356] "Generic (PLEG): container finished" podID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerID="1f7adbabb9aafe5860954a5c96cbaa8bf74e47ed17519524c37cf391d8601459" exitCode=0 Jun 11 17:55:28.751929 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:28.751886 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" event={"ID":"588a62d7-ba86-4d2f-861e-31fcd6b34de8","Type":"ContainerDied","Data":"1f7adbabb9aafe5860954a5c96cbaa8bf74e47ed17519524c37cf391d8601459"} Jun 11 17:55:29.760239 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.760146 2574 generic.go:356] "Generic (PLEG): container finished" podID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerID="c492eb48eb5c15c90a0d340e68d15a6f1f45918df3e83408f7329e55325e93fe" exitCode=0 Jun 11 17:55:29.760634 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.760235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" event={"ID":"1357cefe-dd7e-4f85-9020-7dd141e0b5df","Type":"ContainerDied","Data":"c492eb48eb5c15c90a0d340e68d15a6f1f45918df3e83408f7329e55325e93fe"} Jun 11 17:55:29.762512 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.762486 2574 generic.go:356] "Generic (PLEG): container finished" podID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerID="a98f072468056e9c67c5c78d51f20be15bbafa05b12ca120efc98400eaf770d4" exitCode=0 Jun 11 17:55:29.762598 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.762570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" event={"ID":"21670ca2-e4ff-45b9-89bc-6ec2540b6025","Type":"ContainerDied","Data":"a98f072468056e9c67c5c78d51f20be15bbafa05b12ca120efc98400eaf770d4"} Jun 11 17:55:29.764631 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.764610 2574 generic.go:356] "Generic (PLEG): container finished" podID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerID="51da025d22ca7142569636386380c2044ec80f60442b1c9c7b2facc19c95fa6e" exitCode=0 Jun 11 17:55:29.764702 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.764669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" event={"ID":"588a62d7-ba86-4d2f-861e-31fcd6b34de8","Type":"ContainerDied","Data":"51da025d22ca7142569636386380c2044ec80f60442b1c9c7b2facc19c95fa6e"} Jun 11 17:55:29.898228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.898201 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:29.982866 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.982837 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle\") pod \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " Jun 11 17:55:29.982983 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.982877 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util\") pod \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " Jun 11 17:55:29.982983 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.982964 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ndw\" (UniqueName: \"kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw\") pod \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\" (UID: \"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3\") " Jun 11 17:55:29.983366 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.983329 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle" (OuterVolumeSpecName: "bundle") pod "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" (UID: "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:29.985044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.985025 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw" (OuterVolumeSpecName: "kube-api-access-v2ndw") pod "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" (UID: "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3"). InnerVolumeSpecName "kube-api-access-v2ndw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:55:29.988740 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:29.988720 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util" (OuterVolumeSpecName: "util") pod "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" (UID: "c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:30.084073 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.083997 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:30.084073 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.084022 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:30.084073 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.084033 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ndw\" (UniqueName: \"kubernetes.io/projected/c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3-kube-api-access-v2ndw\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:30.772296 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.772271 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" Jun 11 17:55:30.772682 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.772274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m" event={"ID":"c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3","Type":"ContainerDied","Data":"c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906"} Jun 11 17:55:30.772682 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.772392 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8feb327268fa16da52d36bb4394ff54057d1926eff3a356c306bd5db7950906" Jun 11 17:55:30.774790 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.774764 2574 generic.go:356] "Generic (PLEG): container finished" podID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerID="eac9470fcaa245fc3a9c08e3ca9faaab45540fb79ba8dd9c8f33f76b907faa7a" exitCode=0 Jun 11 17:55:30.774925 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.774830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" event={"ID":"1357cefe-dd7e-4f85-9020-7dd141e0b5df","Type":"ContainerDied","Data":"eac9470fcaa245fc3a9c08e3ca9faaab45540fb79ba8dd9c8f33f76b907faa7a"} Jun 11 17:55:30.909079 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.909055 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:30.943113 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.943089 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:30.991136 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.991113 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util\") pod \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " Jun 11 17:55:30.991296 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.991142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle\") pod \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " Jun 11 17:55:30.991296 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.991216 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcxqq\" (UniqueName: \"kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq\") pod \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\" (UID: \"21670ca2-e4ff-45b9-89bc-6ec2540b6025\") " Jun 11 17:55:30.991735 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.991695 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle" (OuterVolumeSpecName: "bundle") pod "21670ca2-e4ff-45b9-89bc-6ec2540b6025" (UID: "21670ca2-e4ff-45b9-89bc-6ec2540b6025"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:30.993256 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.993234 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq" (OuterVolumeSpecName: "kube-api-access-vcxqq") pod "21670ca2-e4ff-45b9-89bc-6ec2540b6025" (UID: "21670ca2-e4ff-45b9-89bc-6ec2540b6025"). InnerVolumeSpecName "kube-api-access-vcxqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:55:30.996554 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:30.996532 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util" (OuterVolumeSpecName: "util") pod "21670ca2-e4ff-45b9-89bc-6ec2540b6025" (UID: "21670ca2-e4ff-45b9-89bc-6ec2540b6025"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:31.092770 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092713 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle\") pod \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " Jun 11 17:55:31.092770 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092743 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wtmm\" (UniqueName: \"kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm\") pod \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " Jun 11 17:55:31.092913 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092818 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util\") pod \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\" (UID: \"588a62d7-ba86-4d2f-861e-31fcd6b34de8\") " Jun 11 17:55:31.092984 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092974 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.093036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092986 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21670ca2-e4ff-45b9-89bc-6ec2540b6025-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.093036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.092994 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcxqq\" (UniqueName: \"kubernetes.io/projected/21670ca2-e4ff-45b9-89bc-6ec2540b6025-kube-api-access-vcxqq\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.093463 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.093438 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle" (OuterVolumeSpecName: "bundle") pod "588a62d7-ba86-4d2f-861e-31fcd6b34de8" (UID: "588a62d7-ba86-4d2f-861e-31fcd6b34de8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:31.094813 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.094791 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm" (OuterVolumeSpecName: "kube-api-access-2wtmm") pod "588a62d7-ba86-4d2f-861e-31fcd6b34de8" (UID: "588a62d7-ba86-4d2f-861e-31fcd6b34de8"). InnerVolumeSpecName "kube-api-access-2wtmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:55:31.098340 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.098316 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util" (OuterVolumeSpecName: "util") pod "588a62d7-ba86-4d2f-861e-31fcd6b34de8" (UID: "588a62d7-ba86-4d2f-861e-31fcd6b34de8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:31.193741 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.193713 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.193741 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.193736 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/588a62d7-ba86-4d2f-861e-31fcd6b34de8-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.193884 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.193750 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wtmm\" (UniqueName: \"kubernetes.io/projected/588a62d7-ba86-4d2f-861e-31fcd6b34de8-kube-api-access-2wtmm\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:31.782647 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.782610 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" Jun 11 17:55:31.783036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.782610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq" event={"ID":"21670ca2-e4ff-45b9-89bc-6ec2540b6025","Type":"ContainerDied","Data":"5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3"} Jun 11 17:55:31.783036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.782750 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f2c625be88e06a0860e2f50d969f9f020f8af49bb3a1a8592f21b94bc1c95a3" Jun 11 17:55:31.784549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.784530 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" Jun 11 17:55:31.784684 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.784569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67" event={"ID":"588a62d7-ba86-4d2f-861e-31fcd6b34de8","Type":"ContainerDied","Data":"86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754"} Jun 11 17:55:31.784684 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.784604 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86608c818ea4e3e73f11996c07b392ef369c66769d90eabbd1c5ec182f17b754" Jun 11 17:55:31.922103 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:31.922081 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:32.102509 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.102427 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle\") pod \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " Jun 11 17:55:32.102509 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.102487 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w7pt\" (UniqueName: \"kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt\") pod \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " Jun 11 17:55:32.102729 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.102526 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util\") pod \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\" (UID: \"1357cefe-dd7e-4f85-9020-7dd141e0b5df\") " Jun 11 17:55:32.102873 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.102849 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle" (OuterVolumeSpecName: "bundle") pod "1357cefe-dd7e-4f85-9020-7dd141e0b5df" (UID: "1357cefe-dd7e-4f85-9020-7dd141e0b5df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:32.104549 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.104526 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt" (OuterVolumeSpecName: "kube-api-access-6w7pt") pod "1357cefe-dd7e-4f85-9020-7dd141e0b5df" (UID: "1357cefe-dd7e-4f85-9020-7dd141e0b5df"). InnerVolumeSpecName "kube-api-access-6w7pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:55:32.107890 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.107868 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util" (OuterVolumeSpecName: "util") pod "1357cefe-dd7e-4f85-9020-7dd141e0b5df" (UID: "1357cefe-dd7e-4f85-9020-7dd141e0b5df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:55:32.204110 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.204080 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w7pt\" (UniqueName: \"kubernetes.io/projected/1357cefe-dd7e-4f85-9020-7dd141e0b5df-kube-api-access-6w7pt\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:32.204110 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.204109 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:32.204276 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.204122 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1357cefe-dd7e-4f85-9020-7dd141e0b5df-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:55:32.791919 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.791886 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" event={"ID":"1357cefe-dd7e-4f85-9020-7dd141e0b5df","Type":"ContainerDied","Data":"6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b"} Jun 11 17:55:32.792323 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.791930 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7" Jun 11 17:55:32.792323 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:32.791934 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f61413a9418a54c843548fd4db6b5c54c8f1d459f6145dc511ccec7d2c3d07b" Jun 11 17:55:49.679570 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679534 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2"] Jun 11 17:55:49.679961 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679944 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="util" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679963 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="util" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679973 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="pull" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679978 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="pull" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679988 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="util" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.679994 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="util" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680002 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="util" Jun 11 17:55:49.680008 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680007 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="util" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680016 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="util" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680021 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="util" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680029 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680035 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680042 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680047 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680053 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680058 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680074 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680079 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="pull" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680085 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680089 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680094 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680099 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680106 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680110 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680190 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1357cefe-dd7e-4f85-9020-7dd141e0b5df" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680198 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="588a62d7-ba86-4d2f-861e-31fcd6b34de8" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680205 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="21670ca2-e4ff-45b9-89bc-6ec2540b6025" containerName="extract" Jun 11 17:55:49.680258 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.680211 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3" containerName="extract" Jun 11 17:55:49.683433 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.683355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:49.686525 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.686497 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 17:55:49.686525 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.686497 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 17:55:49.686701 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.686620 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 17:55:49.687715 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.687693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tmlhz\"" Jun 11 17:55:49.700236 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.700213 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2"] Jun 11 17:55:49.758277 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.758247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lvh\" (UniqueName: \"kubernetes.io/projected/5a4f87bc-7b94-4e9e-a079-ea6cafe23138-kube-api-access-p5lvh\") pod \"dns-operator-controller-manager-864dd78c4c-tgqg2\" (UID: \"5a4f87bc-7b94-4e9e-a079-ea6cafe23138\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:49.858656 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.858618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lvh\" (UniqueName: \"kubernetes.io/projected/5a4f87bc-7b94-4e9e-a079-ea6cafe23138-kube-api-access-p5lvh\") pod \"dns-operator-controller-manager-864dd78c4c-tgqg2\" (UID: \"5a4f87bc-7b94-4e9e-a079-ea6cafe23138\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:49.871092 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.871064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lvh\" (UniqueName: \"kubernetes.io/projected/5a4f87bc-7b94-4e9e-a079-ea6cafe23138-kube-api-access-p5lvh\") pod \"dns-operator-controller-manager-864dd78c4c-tgqg2\" (UID: \"5a4f87bc-7b94-4e9e-a079-ea6cafe23138\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:49.996827 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:49.996804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:50.133277 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:50.133253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2"] Jun 11 17:55:50.134373 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:50.134345 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4f87bc_7b94_4e9e_a079_ea6cafe23138.slice/crio-51671f4d3d4a61ea5773d930b3601116530fe45857f411218c58975cc9315992 WatchSource:0}: Error finding container 51671f4d3d4a61ea5773d930b3601116530fe45857f411218c58975cc9315992: Status 404 returned error can't find the container with id 51671f4d3d4a61ea5773d930b3601116530fe45857f411218c58975cc9315992 Jun 11 17:55:50.904678 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:50.904634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" event={"ID":"5a4f87bc-7b94-4e9e-a079-ea6cafe23138","Type":"ContainerStarted","Data":"51671f4d3d4a61ea5773d930b3601116530fe45857f411218c58975cc9315992"} Jun 11 17:55:52.917672 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:52.917640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" event={"ID":"5a4f87bc-7b94-4e9e-a079-ea6cafe23138","Type":"ContainerStarted","Data":"97a1faaa77b8fe5ef7929d0829969944114c592c8a832888b8230cb8b6188c48"} Jun 11 17:55:52.918234 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:52.917729 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:55:52.935454 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:52.935406 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" podStartSLOduration=1.7863177989999999 podStartE2EDuration="3.935392544s" totalImagesPullingTime="2.149074745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:55:52.933368184 +0000 UTC m=+509.027461691" watchObservedRunningTime="2026-06-11 17:55:52.935392544 +0000 UTC m=+509.029486051" Jun 11 17:55:54.142450 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.142417 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2"] Jun 11 17:55:54.146415 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.146393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.149044 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.149022 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jlvpc\"" Jun 11 17:55:54.158382 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.158360 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2"] Jun 11 17:55:54.197972 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.197941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.197972 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.197972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prqdh\" (UniqueName: \"kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.298420 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.298391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.298420 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.298421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prqdh\" (UniqueName: \"kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.298756 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.298738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.306669 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.306647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prqdh\" (UniqueName: \"kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.458206 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.458158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:55:54.614344 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.614309 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2"] Jun 11 17:55:54.615460 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:55:54.615434 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2b42d3_bc6e_486a_acf6_ed9c474ea109.slice/crio-c18680247c5e66d924a2c0f84e2fc477088aeb70e6d900aca645968914054c86 WatchSource:0}: Error finding container c18680247c5e66d924a2c0f84e2fc477088aeb70e6d900aca645968914054c86: Status 404 returned error can't find the container with id c18680247c5e66d924a2c0f84e2fc477088aeb70e6d900aca645968914054c86 Jun 11 17:55:54.931431 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:55:54.931339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" event={"ID":"aa2b42d3-bc6e-486a-acf6-ed9c474ea109","Type":"ContainerStarted","Data":"c18680247c5e66d924a2c0f84e2fc477088aeb70e6d900aca645968914054c86"} Jun 11 17:56:01.978533 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:01.978498 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" event={"ID":"aa2b42d3-bc6e-486a-acf6-ed9c474ea109","Type":"ContainerStarted","Data":"aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b"} Jun 11 17:56:01.978947 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:01.978656 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:02.003277 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:02.003225 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" podStartSLOduration=1.695975206 podStartE2EDuration="8.003212666s" totalImagesPullingTime="6.30723746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:56:01.999900588 +0000 UTC m=+518.093994088" watchObservedRunningTime="2026-06-11 17:56:02.003212666 +0000 UTC m=+518.097306241" Jun 11 17:56:03.926688 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:03.926662 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tgqg2" Jun 11 17:56:11.725374 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:11.725339 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:56:12.987550 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:12.987523 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:14.685954 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.685875 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2"] Jun 11 17:56:14.686400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.686061 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" containerName="manager" containerID="cri-o://aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b" gracePeriod=2 Jun 11 17:56:14.700828 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.700795 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2"] Jun 11 17:56:14.701512 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:14.701473 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-q88m2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:14.715271 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.715239 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:14.715933 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.715898 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" containerName="manager" Jun 11 17:56:14.715933 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.715923 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" containerName="manager" Jun 11 17:56:14.716078 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.716014 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" containerName="manager" Jun 11 17:56:14.719511 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.719493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:14.732588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.732562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:14.745893 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:14.745850 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" is forbidden: User \"system:node:ip-10-0-133-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-204.ec2.internal' and this object" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:14.887754 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.887724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspfl\" (UniqueName: \"kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:14.887897 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.887865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:14.942321 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.942272 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:14.944696 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:14.944669 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" is forbidden: User \"system:node:ip-10-0-133-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-204.ec2.internal' and this object" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:14.988947 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.988914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:14.989065 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.988963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspfl\" (UniqueName: \"kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:14.989326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:14.989307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:15.009501 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.009476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspfl\" (UniqueName: \"kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qtct4\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:15.062588 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.062554 2574 generic.go:356] "Generic (PLEG): container finished" podID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" containerID="aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b" exitCode=0 Jun 11 17:56:15.062761 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.062600 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:15.062761 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.062622 2574 scope.go:117] "RemoveContainer" containerID="aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b" Jun 11 17:56:15.065865 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:15.065834 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" is forbidden: User \"system:node:ip-10-0-133-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-204.ec2.internal' and this object" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:15.068019 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.067998 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:15.072504 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.072481 2574 scope.go:117] "RemoveContainer" containerID="aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b" Jun 11 17:56:15.072768 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:15.072748 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b\": container with ID starting with aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b not found: ID does not exist" containerID="aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b" Jun 11 17:56:15.072828 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.072778 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b"} err="failed to get container status \"aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b\": rpc error: code = NotFound desc = could not find container \"aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b\": container with ID starting with aa7a78e87a834a815f3c144fbf55943115dbdc9548684ce13eafe280bfd13b1b not found: ID does not exist" Jun 11 17:56:15.090188 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.090144 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prqdh\" (UniqueName: \"kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh\") pod \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " Jun 11 17:56:15.090332 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.090303 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume\") pod \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\" (UID: \"aa2b42d3-bc6e-486a-acf6-ed9c474ea109\") " Jun 11 17:56:15.090822 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.090795 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa2b42d3-bc6e-486a-acf6-ed9c474ea109" (UID: "aa2b42d3-bc6e-486a-acf6-ed9c474ea109"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:56:15.092348 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.092323 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh" (OuterVolumeSpecName: "kube-api-access-prqdh") pod "aa2b42d3-bc6e-486a-acf6-ed9c474ea109" (UID: "aa2b42d3-bc6e-486a-acf6-ed9c474ea109"). InnerVolumeSpecName "kube-api-access-prqdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:56:15.191790 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.191758 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prqdh\" (UniqueName: \"kubernetes.io/projected/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-kube-api-access-prqdh\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:15.191790 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.191788 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2b42d3-bc6e-486a-acf6-ed9c474ea109-extensions-socket-volume\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:15.215729 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:15.215703 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:15.217625 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:56:15.217597 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d86fde8_4cf4_44d3_8a05_32ba7140fe4e.slice/crio-a6f6024066fa158c6697a38b56dc19747dc75774055bd615a6692782ec3adfc6 WatchSource:0}: Error finding container a6f6024066fa158c6697a38b56dc19747dc75774055bd615a6692782ec3adfc6: Status 404 returned error can't find the container with id a6f6024066fa158c6697a38b56dc19747dc75774055bd615a6692782ec3adfc6 Jun 11 17:56:15.373167 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:15.373137 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" is forbidden: User \"system:node:ip-10-0-133-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-204.ec2.internal' and this object" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:16.070014 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:16.069922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" event={"ID":"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e","Type":"ContainerStarted","Data":"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946"} Jun 11 17:56:16.070014 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:16.069978 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" event={"ID":"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e","Type":"ContainerStarted","Data":"a6f6024066fa158c6697a38b56dc19747dc75774055bd615a6692782ec3adfc6"} Jun 11 17:56:16.070521 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:16.070108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:16.095648 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:16.095612 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q88m2\" is forbidden: User \"system:node:ip-10-0-133-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-204.ec2.internal' and this object" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q88m2" Jun 11 17:56:16.096371 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:16.096333 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" podStartSLOduration=2.096320345 podStartE2EDuration="2.096320345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:56:16.093480875 +0000 UTC m=+532.187574384" watchObservedRunningTime="2026-06-11 17:56:16.096320345 +0000 UTC m=+532.190413849" Jun 11 17:56:16.376473 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:16.376399 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2b42d3-bc6e-486a-acf6-ed9c474ea109" path="/var/lib/kubelet/pods/aa2b42d3-bc6e-486a-acf6-ed9c474ea109/volumes" Jun 11 17:56:27.078860 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:27.078826 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:32.501181 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.501136 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:32.501659 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.501354 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" podUID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" containerName="manager" containerID="cri-o://f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946" gracePeriod=10 Jun 11 17:56:32.732203 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.732154 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 17:56:32.735921 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.735901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.752123 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.752075 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 17:56:32.757091 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.757071 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:32.838946 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.838915 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume\") pod \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " Jun 11 17:56:32.839098 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.838987 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fspfl\" (UniqueName: \"kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl\") pod \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\" (UID: \"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e\") " Jun 11 17:56:32.839138 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.839114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5lbk\" (UniqueName: \"kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.839194 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.839136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.839400 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.839374 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" (UID: "9d86fde8-4cf4-44d3-8a05-32ba7140fe4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:56:32.841071 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.841053 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl" (OuterVolumeSpecName: "kube-api-access-fspfl") pod "9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" (UID: "9d86fde8-4cf4-44d3-8a05-32ba7140fe4e"). InnerVolumeSpecName "kube-api-access-fspfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:56:32.940518 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.940493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5lbk\" (UniqueName: \"kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.940646 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.940525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.940646 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.940624 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fspfl\" (UniqueName: \"kubernetes.io/projected/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-kube-api-access-fspfl\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:32.940646 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.940636 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e-extensions-socket-volume\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:32.940913 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.940892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:32.951036 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:32.951010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5lbk\" (UniqueName: \"kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk\") pod \"kuadrant-operator-controller-manager-86878c769f-2974q\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:33.063857 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.063777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:33.177700 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.177670 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" containerID="f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946" exitCode=0 Jun 11 17:56:33.177866 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.177736 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" Jun 11 17:56:33.177866 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.177751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" event={"ID":"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e","Type":"ContainerDied","Data":"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946"} Jun 11 17:56:33.177866 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.177814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4" event={"ID":"9d86fde8-4cf4-44d3-8a05-32ba7140fe4e","Type":"ContainerDied","Data":"a6f6024066fa158c6697a38b56dc19747dc75774055bd615a6692782ec3adfc6"} Jun 11 17:56:33.177866 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.177845 2574 scope.go:117] "RemoveContainer" containerID="f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946" Jun 11 17:56:33.187892 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.187871 2574 scope.go:117] "RemoveContainer" containerID="f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946" Jun 11 17:56:33.188145 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:33.188127 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946\": container with ID starting with f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946 not found: ID does not exist" containerID="f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946" Jun 11 17:56:33.188220 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.188154 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946"} err="failed to get container status \"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946\": rpc error: code = NotFound desc = could not find container \"f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946\": container with ID starting with f0dde76a4aeaa79281aa33cd9c0aee095149a0b9f21780b695d458be82198946 not found: ID does not exist" Jun 11 17:56:33.203936 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.203912 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 17:56:33.204891 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:56:33.204872 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3645c5f6_db31_4bf1_a9ef_cb00feff910c.slice/crio-2b06c6b597d4f28ccd947f47fd798f6bbfb31c69a8287c4feff4b10a7ed5db1e WatchSource:0}: Error finding container 2b06c6b597d4f28ccd947f47fd798f6bbfb31c69a8287c4feff4b10a7ed5db1e: Status 404 returned error can't find the container with id 2b06c6b597d4f28ccd947f47fd798f6bbfb31c69a8287c4feff4b10a7ed5db1e Jun 11 17:56:33.206484 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.206463 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:33.212709 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:33.212688 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qtct4"] Jun 11 17:56:34.186928 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:34.186889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" event={"ID":"3645c5f6-db31-4bf1-a9ef-cb00feff910c","Type":"ContainerStarted","Data":"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc"} Jun 11 17:56:34.187310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:34.187040 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:34.187310 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:34.187076 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" event={"ID":"3645c5f6-db31-4bf1-a9ef-cb00feff910c","Type":"ContainerStarted","Data":"2b06c6b597d4f28ccd947f47fd798f6bbfb31c69a8287c4feff4b10a7ed5db1e"} Jun 11 17:56:34.217861 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:34.217816 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" podStartSLOduration=2.217800864 podStartE2EDuration="2.217800864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:56:34.216384348 +0000 UTC m=+550.310477869" watchObservedRunningTime="2026-06-11 17:56:34.217800864 +0000 UTC m=+550.311894371" Jun 11 17:56:34.376085 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:34.376050 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" path="/var/lib/kubelet/pods/9d86fde8-4cf4-44d3-8a05-32ba7140fe4e/volumes" Jun 11 17:56:36.746860 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:36.746803 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6479db759b-nwvkr" podUID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" containerName="console" containerID="cri-o://6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164" gracePeriod=15 Jun 11 17:56:37.001585 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.001524 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:56:37.077614 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077589 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077776 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077630 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077776 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077654 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077776 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077741 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077888 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077793 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077888 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7xsf\" (UniqueName: \"kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.077888 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.077865 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert\") pod \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\" (UID: \"13fbccac-759a-4291-8cfe-3fd6d8bc5609\") " Jun 11 17:56:37.078108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.078059 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config" (OuterVolumeSpecName: "console-config") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:56:37.078108 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.078093 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:56:37.078255 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.078159 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca" (OuterVolumeSpecName: "service-ca") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:56:37.078308 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.078253 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:56:37.079890 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.079855 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:56:37.080024 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.080000 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf" (OuterVolumeSpecName: "kube-api-access-n7xsf") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "kube-api-access-n7xsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:56:37.080085 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.080036 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13fbccac-759a-4291-8cfe-3fd6d8bc5609" (UID: "13fbccac-759a-4291-8cfe-3fd6d8bc5609"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:56:37.178721 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178689 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-oauth-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178721 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178716 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7xsf\" (UniqueName: \"kubernetes.io/projected/13fbccac-759a-4291-8cfe-3fd6d8bc5609-kube-api-access-n7xsf\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178721 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178726 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-serving-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178916 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178735 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178916 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178743 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fbccac-759a-4291-8cfe-3fd6d8bc5609-console-oauth-config\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178916 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178751 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-trusted-ca-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.178916 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.178759 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fbccac-759a-4291-8cfe-3fd6d8bc5609-service-ca\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:56:37.206149 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.206122 2574 generic.go:356] "Generic (PLEG): container finished" podID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" containerID="6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164" exitCode=0 Jun 11 17:56:37.206317 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.206163 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6479db759b-nwvkr" Jun 11 17:56:37.206317 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.206211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479db759b-nwvkr" event={"ID":"13fbccac-759a-4291-8cfe-3fd6d8bc5609","Type":"ContainerDied","Data":"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164"} Jun 11 17:56:37.206317 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.206268 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6479db759b-nwvkr" event={"ID":"13fbccac-759a-4291-8cfe-3fd6d8bc5609","Type":"ContainerDied","Data":"c029a0381bc724bd6f74ff98993ca8a44d1c69dc9fde2d7bf172a772f249ea3c"} Jun 11 17:56:37.206317 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.206295 2574 scope.go:117] "RemoveContainer" containerID="6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164" Jun 11 17:56:37.215697 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.215681 2574 scope.go:117] "RemoveContainer" containerID="6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164" Jun 11 17:56:37.215943 ip-10-0-133-204 kubenswrapper[2574]: E0611 17:56:37.215928 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164\": container with ID starting with 6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164 not found: ID does not exist" containerID="6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164" Jun 11 17:56:37.215983 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.215950 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164"} err="failed to get container status \"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164\": rpc error: code = NotFound desc = could not find container \"6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164\": container with ID starting with 6c20ca72d5231cc4506a9a960a519ce58320e8e224b048a929874262d189d164 not found: ID does not exist" Jun 11 17:56:37.230490 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.230468 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:56:37.232782 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:37.232763 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6479db759b-nwvkr"] Jun 11 17:56:38.377030 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:38.376990 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" path="/var/lib/kubelet/pods/13fbccac-759a-4291-8cfe-3fd6d8bc5609/volumes" Jun 11 17:56:45.195873 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:45.195835 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 17:56:52.392215 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392181 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 17:56:52.392618 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392596 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" containerName="manager" Jun 11 17:56:52.392618 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392612 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" containerName="manager" Jun 11 17:56:52.392704 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392631 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" containerName="console" Jun 11 17:56:52.392704 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392665 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" containerName="console" Jun 11 17:56:52.392768 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392740 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="13fbccac-759a-4291-8cfe-3fd6d8bc5609" containerName="console" Jun 11 17:56:52.392768 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.392751 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d86fde8-4cf4-44d3-8a05-32ba7140fe4e" containerName="manager" Jun 11 17:56:52.395883 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.395865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.398226 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.398193 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 17:56:52.398326 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.398306 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bqzt6\"" Jun 11 17:56:52.407248 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.407221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 17:56:52.433431 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.433404 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 17:56:52.509999 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.509970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqxm\" (UniqueName: \"kubernetes.io/projected/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-kube-api-access-mtqxm\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.510243 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.510219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-config-file\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.611083 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.611050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-config-file\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.611239 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.611103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqxm\" (UniqueName: \"kubernetes.io/projected/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-kube-api-access-mtqxm\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.611702 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.611681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-config-file\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.619813 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.619784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqxm\" (UniqueName: \"kubernetes.io/projected/bacc96aa-2d09-4d93-ba22-d4fcf18d36cf-kube-api-access-mtqxm\") pod \"limitador-limitador-54d6d988d5-2lhln\" (UID: \"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.706100 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.706070 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:52.844071 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:52.844038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 17:56:52.845422 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:56:52.845394 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacc96aa_2d09_4d93_ba22_d4fcf18d36cf.slice/crio-89a39df1c8ff2d68e9d1570be695472a6460e1efa90e27226bb7fd88edb1c514 WatchSource:0}: Error finding container 89a39df1c8ff2d68e9d1570be695472a6460e1efa90e27226bb7fd88edb1c514: Status 404 returned error can't find the container with id 89a39df1c8ff2d68e9d1570be695472a6460e1efa90e27226bb7fd88edb1c514 Jun 11 17:56:53.305349 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:53.305307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" event={"ID":"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf","Type":"ContainerStarted","Data":"89a39df1c8ff2d68e9d1570be695472a6460e1efa90e27226bb7fd88edb1c514"} Jun 11 17:56:56.324754 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:56.324708 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" event={"ID":"bacc96aa-2d09-4d93-ba22-d4fcf18d36cf","Type":"ContainerStarted","Data":"c4f0bc17f9d27d25529df85af48a0b8ae3a1929e3dafc21ec99f06c17930d821"} Jun 11 17:56:56.325136 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:56.324789 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:56:56.344705 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:56:56.344662 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" podStartSLOduration=1.671297553 podStartE2EDuration="4.344649344s" totalImagesPullingTime="2.673351791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:56:56.341637759 +0000 UTC m=+572.435731294" watchObservedRunningTime="2026-06-11 17:56:56.344649344 +0000 UTC m=+572.438742851" Jun 11 17:57:07.339820 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:07.339789 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2lhln" Jun 11 17:57:23.212451 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.212418 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x"] Jun 11 17:57:23.216491 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.216467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.220620 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.220589 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 17:57:23.220753 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.220735 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6pvt\"" Jun 11 17:57:23.223367 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.223159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 17:57:23.242228 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.242205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x"] Jun 11 17:57:23.275760 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.275731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.275914 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.275764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7dr\" (UniqueName: \"kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.275981 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.275925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.377026 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.376995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.377212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.377029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7dr\" (UniqueName: \"kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.377212 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.377131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.377461 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.377439 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.377532 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.377483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.387155 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.387133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7dr\" (UniqueName: \"kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.526081 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.526018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:23.663521 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:23.663492 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x"] Jun 11 17:57:23.664749 ip-10-0-133-204 kubenswrapper[2574]: W0611 17:57:23.664722 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c438ac_6588_413a_b1cf_82eb83372411.slice/crio-2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7 WatchSource:0}: Error finding container 2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7: Status 404 returned error can't find the container with id 2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7 Jun 11 17:57:24.363267 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:24.363237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:57:24.363708 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:24.363562 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 17:57:24.497778 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:24.497745 2574 generic.go:356] "Generic (PLEG): container finished" podID="21c438ac-6588-413a-b1cf-82eb83372411" containerID="ae8b81427ffacb9561fc352e3c157c7fb0e263608fca5b0c8207a95d0f956760" exitCode=0 Jun 11 17:57:24.497931 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:24.497832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" event={"ID":"21c438ac-6588-413a-b1cf-82eb83372411","Type":"ContainerDied","Data":"ae8b81427ffacb9561fc352e3c157c7fb0e263608fca5b0c8207a95d0f956760"} Jun 11 17:57:24.497931 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:24.497887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" event={"ID":"21c438ac-6588-413a-b1cf-82eb83372411","Type":"ContainerStarted","Data":"2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7"} Jun 11 17:57:25.505266 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:25.505229 2574 generic.go:356] "Generic (PLEG): container finished" podID="21c438ac-6588-413a-b1cf-82eb83372411" containerID="241261fdfb38bc4a8643fb940e7641bbcc5dc9d7b17783a99707fdc9aaafece7" exitCode=0 Jun 11 17:57:25.505638 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:25.505307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" event={"ID":"21c438ac-6588-413a-b1cf-82eb83372411","Type":"ContainerDied","Data":"241261fdfb38bc4a8643fb940e7641bbcc5dc9d7b17783a99707fdc9aaafece7"} Jun 11 17:57:26.512857 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:26.512827 2574 generic.go:356] "Generic (PLEG): container finished" podID="21c438ac-6588-413a-b1cf-82eb83372411" containerID="331cc11c0a21b6cf97cc1e64e729648d974d95ff272045c5f669221bb17f3697" exitCode=0 Jun 11 17:57:26.513231 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:26.512906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" event={"ID":"21c438ac-6588-413a-b1cf-82eb83372411","Type":"ContainerDied","Data":"331cc11c0a21b6cf97cc1e64e729648d974d95ff272045c5f669221bb17f3697"} Jun 11 17:57:27.667385 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.667359 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:27.716128 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.716101 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7dr\" (UniqueName: \"kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr\") pod \"21c438ac-6588-413a-b1cf-82eb83372411\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " Jun 11 17:57:27.716276 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.716251 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util\") pod \"21c438ac-6588-413a-b1cf-82eb83372411\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " Jun 11 17:57:27.716335 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.716279 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle\") pod \"21c438ac-6588-413a-b1cf-82eb83372411\" (UID: \"21c438ac-6588-413a-b1cf-82eb83372411\") " Jun 11 17:57:27.716864 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.716839 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle" (OuterVolumeSpecName: "bundle") pod "21c438ac-6588-413a-b1cf-82eb83372411" (UID: "21c438ac-6588-413a-b1cf-82eb83372411"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:57:27.718284 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.718260 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr" (OuterVolumeSpecName: "kube-api-access-fr7dr") pod "21c438ac-6588-413a-b1cf-82eb83372411" (UID: "21c438ac-6588-413a-b1cf-82eb83372411"). InnerVolumeSpecName "kube-api-access-fr7dr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:57:27.722167 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.722144 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util" (OuterVolumeSpecName: "util") pod "21c438ac-6588-413a-b1cf-82eb83372411" (UID: "21c438ac-6588-413a-b1cf-82eb83372411"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:57:27.817082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.817018 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7dr\" (UniqueName: \"kubernetes.io/projected/21c438ac-6588-413a-b1cf-82eb83372411-kube-api-access-fr7dr\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:57:27.817082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.817045 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-util\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:57:27.817082 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:27.817054 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c438ac-6588-413a-b1cf-82eb83372411-bundle\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 17:57:28.529757 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:28.529731 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" Jun 11 17:57:28.529924 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:28.529765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fn98x" event={"ID":"21c438ac-6588-413a-b1cf-82eb83372411","Type":"ContainerDied","Data":"2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7"} Jun 11 17:57:28.529924 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:57:28.529816 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d00ced79fb86ceb7f6141ab2476c4f9741358f9b48a6523e3696f3f4e9010b7" Jun 11 17:58:55.724995 ip-10-0-133-204 kubenswrapper[2574]: I0611 17:58:55.724958 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.140651 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb"] Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142485 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="extract" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142508 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="extract" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142532 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="pull" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142542 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="pull" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142556 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="util" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142565 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="util" Jun 11 18:02:14.143544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.142698 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c438ac-6588-413a-b1cf-82eb83372411" containerName="extract" Jun 11 18:02:14.146653 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.146631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.149506 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.149485 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 18:02:14.149629 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.149489 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 18:02:14.149703 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.149634 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vtwnj\"" Jun 11 18:02:14.150782 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.150755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 18:02:14.157238 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.157214 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb"] Jun 11 18:02:14.225524 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g9k4\" (UniqueName: \"kubernetes.io/projected/44427006-044e-4310-b07b-e7d392da6827-kube-api-access-9g9k4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.225638 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.225638 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.225757 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44427006-044e-4310-b07b-e7d392da6827-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.225757 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.225832 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.225786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.326623 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g9k4\" (UniqueName: \"kubernetes.io/projected/44427006-044e-4310-b07b-e7d392da6827-kube-api-access-9g9k4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.326786 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.326786 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.326884 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44427006-044e-4310-b07b-e7d392da6827-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.326884 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.327005 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.326990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.327405 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.327373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.327529 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.327452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.327529 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.327469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.329308 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.329286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44427006-044e-4310-b07b-e7d392da6827-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.329722 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.329687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44427006-044e-4310-b07b-e7d392da6827-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.334084 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.334061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g9k4\" (UniqueName: \"kubernetes.io/projected/44427006-044e-4310-b07b-e7d392da6827-kube-api-access-9g9k4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb\" (UID: \"44427006-044e-4310-b07b-e7d392da6827\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.476770 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.476730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:14.526772 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.526737 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:02:14.616254 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.616231 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb"] Jun 11 18:02:14.617093 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:02:14.617062 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44427006_044e_4310_b07b_e7d392da6827.slice/crio-21ba2bfeebfb68d1f73440de64d1ef1e5ed30a1d4df227e8d62a7784c7a34490 WatchSource:0}: Error finding container 21ba2bfeebfb68d1f73440de64d1ef1e5ed30a1d4df227e8d62a7784c7a34490: Status 404 returned error can't find the container with id 21ba2bfeebfb68d1f73440de64d1ef1e5ed30a1d4df227e8d62a7784c7a34490 Jun 11 18:02:14.618987 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:14.618969 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:02:15.224887 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:15.224846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" event={"ID":"44427006-044e-4310-b07b-e7d392da6827","Type":"ContainerStarted","Data":"21ba2bfeebfb68d1f73440de64d1ef1e5ed30a1d4df227e8d62a7784c7a34490"} Jun 11 18:02:19.254952 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:19.254909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" event={"ID":"44427006-044e-4310-b07b-e7d392da6827","Type":"ContainerStarted","Data":"b605aff18cdfa0bc5fb32e161d8f8156c0321c6dab289784b9e041cfaec9bf06"} Jun 11 18:02:20.263002 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:20.262968 2574 generic.go:356] "Generic (PLEG): container finished" podID="44427006-044e-4310-b07b-e7d392da6827" containerID="b605aff18cdfa0bc5fb32e161d8f8156c0321c6dab289784b9e041cfaec9bf06" exitCode=0 Jun 11 18:02:20.263405 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:20.263035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" event={"ID":"44427006-044e-4310-b07b-e7d392da6827","Type":"ContainerDied","Data":"b605aff18cdfa0bc5fb32e161d8f8156c0321c6dab289784b9e041cfaec9bf06"} Jun 11 18:02:22.278891 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:22.278854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" event={"ID":"44427006-044e-4310-b07b-e7d392da6827","Type":"ContainerStarted","Data":"89f07b98af3a6942c8c4ca8ca109f2c3a4ce0e1f59f07942bbafb4609376c89c"} Jun 11 18:02:22.299713 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:22.299659 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" podStartSLOduration=2.031086077 podStartE2EDuration="8.299645464s" totalImagesPullingTime="4.987102828s" totalInitContainerRuntime="1.281456559s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:02:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:02:22.29672866 +0000 UTC m=+898.390822381" watchObservedRunningTime="2026-06-11 18:02:22.299645464 +0000 UTC m=+898.393738969" Jun 11 18:02:24.411329 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:24.411301 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:02:24.411329 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:24.411324 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:02:24.477674 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:24.477637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:24.477840 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:24.477695 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:24.490359 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:24.490335 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:25.308395 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:25.308370 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb" Jun 11 18:02:26.837050 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:26.837014 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:02:45.831210 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.831162 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp"] Jun 11 18:02:45.845104 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.845082 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp"] Jun 11 18:02:45.845273 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.845225 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.847972 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.847948 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 18:02:45.918396 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.918560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4881a935-ab4e-4b1d-addc-b115899a2f85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.918560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.918560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxwtg\" (UniqueName: \"kubernetes.io/projected/4881a935-ab4e-4b1d-addc-b115899a2f85-kube-api-access-jxwtg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.918560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:45.918560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:45.918536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019040 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019233 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxwtg\" (UniqueName: \"kubernetes.io/projected/4881a935-ab4e-4b1d-addc-b115899a2f85-kube-api-access-jxwtg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019233 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019233 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019233 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019233 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4881a935-ab4e-4b1d-addc-b115899a2f85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019514 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019514 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.019615 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.019553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.021463 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.021438 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4881a935-ab4e-4b1d-addc-b115899a2f85-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.021708 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.021692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4881a935-ab4e-4b1d-addc-b115899a2f85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.026456 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.026427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxwtg\" (UniqueName: \"kubernetes.io/projected/4881a935-ab4e-4b1d-addc-b115899a2f85-kube-api-access-jxwtg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp\" (UID: \"4881a935-ab4e-4b1d-addc-b115899a2f85\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.155881 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.155809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:46.294733 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.294706 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp"] Jun 11 18:02:46.295610 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:02:46.295586 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4881a935_ab4e_4b1d_addc_b115899a2f85.slice/crio-2d698654adfb0bd3d1cdce5e7088403b482e17752fc5a2edf61cbb468a071d3d WatchSource:0}: Error finding container 2d698654adfb0bd3d1cdce5e7088403b482e17752fc5a2edf61cbb468a071d3d: Status 404 returned error can't find the container with id 2d698654adfb0bd3d1cdce5e7088403b482e17752fc5a2edf61cbb468a071d3d Jun 11 18:02:46.424951 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.424869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" event={"ID":"4881a935-ab4e-4b1d-addc-b115899a2f85","Type":"ContainerStarted","Data":"9ebc598c7fc05db47f015dc73df48a7e04dfcf547fcd7b06126d4e965a7a354a"} Jun 11 18:02:46.424951 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.424945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" event={"ID":"4881a935-ab4e-4b1d-addc-b115899a2f85","Type":"ContainerStarted","Data":"2d698654adfb0bd3d1cdce5e7088403b482e17752fc5a2edf61cbb468a071d3d"} Jun 11 18:02:46.528261 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:46.528224 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:02:48.440086 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:48.440051 2574 generic.go:356] "Generic (PLEG): container finished" podID="4881a935-ab4e-4b1d-addc-b115899a2f85" containerID="9ebc598c7fc05db47f015dc73df48a7e04dfcf547fcd7b06126d4e965a7a354a" exitCode=0 Jun 11 18:02:48.440086 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:48.440089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" event={"ID":"4881a935-ab4e-4b1d-addc-b115899a2f85","Type":"ContainerDied","Data":"9ebc598c7fc05db47f015dc73df48a7e04dfcf547fcd7b06126d4e965a7a354a"} Jun 11 18:02:49.449367 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:49.449325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" event={"ID":"4881a935-ab4e-4b1d-addc-b115899a2f85","Type":"ContainerStarted","Data":"e3d5d8dc9d49099fbde0006131f35bdb0a88d9e2b07dd8a561f3c2fe22041882"} Jun 11 18:02:49.472229 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:49.472161 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" podStartSLOduration=2.809870742 podStartE2EDuration="4.472146118s" totalImagesPullingTime="314.893631ms" totalInitContainerRuntime="1.347381745s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:02:49.469312401 +0000 UTC m=+925.563405903" watchObservedRunningTime="2026-06-11 18:02:49.472146118 +0000 UTC m=+925.566239625" Jun 11 18:02:53.941073 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.941037 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw"] Jun 11 18:02:53.945361 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.945342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.947838 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.947817 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 18:02:53.954370 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.954349 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw"] Jun 11 18:02:53.989038 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qpg\" (UniqueName: \"kubernetes.io/projected/2214479a-03ec-4372-9036-21c597923746-kube-api-access-57qpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.989200 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.989200 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.989329 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.989385 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:53.989439 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:53.989401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2214479a-03ec-4372-9036-21c597923746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090793 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090848 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090899 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2214479a-03ec-4372-9036-21c597923746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090953 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qpg\" (UniqueName: \"kubernetes.io/projected/2214479a-03ec-4372-9036-21c597923746-kube-api-access-57qpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.090953 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.091066 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.091066 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.090998 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.091221 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.091205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.092974 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.092945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2214479a-03ec-4372-9036-21c597923746-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.093217 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.093199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2214479a-03ec-4372-9036-21c597923746-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.098633 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.098612 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qpg\" (UniqueName: \"kubernetes.io/projected/2214479a-03ec-4372-9036-21c597923746-kube-api-access-57qpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw\" (UID: \"2214479a-03ec-4372-9036-21c597923746\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.256628 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.256546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:02:54.407202 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.407136 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw"] Jun 11 18:02:54.408069 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:02:54.408038 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2214479a_03ec_4372_9036_21c597923746.slice/crio-d5b545858ce3f1a0fc0f3c2f235fc6994835c009c00bceaa0dd199528d158f99 WatchSource:0}: Error finding container d5b545858ce3f1a0fc0f3c2f235fc6994835c009c00bceaa0dd199528d158f99: Status 404 returned error can't find the container with id d5b545858ce3f1a0fc0f3c2f235fc6994835c009c00bceaa0dd199528d158f99 Jun 11 18:02:54.482262 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:54.482222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" event={"ID":"2214479a-03ec-4372-9036-21c597923746","Type":"ContainerStarted","Data":"d5b545858ce3f1a0fc0f3c2f235fc6994835c009c00bceaa0dd199528d158f99"} Jun 11 18:02:55.032844 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:55.032800 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:02:55.490207 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:55.490153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" event={"ID":"2214479a-03ec-4372-9036-21c597923746","Type":"ContainerStarted","Data":"db690f37a4a50d837090ddb10dd5ab680a8869f981897091be8b6921b1869f7e"} Jun 11 18:02:56.156234 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.156122 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:56.156234 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.156196 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:56.168691 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.168670 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:56.497076 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.497047 2574 generic.go:356] "Generic (PLEG): container finished" podID="2214479a-03ec-4372-9036-21c597923746" containerID="db690f37a4a50d837090ddb10dd5ab680a8869f981897091be8b6921b1869f7e" exitCode=0 Jun 11 18:02:56.497252 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.497138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" event={"ID":"2214479a-03ec-4372-9036-21c597923746","Type":"ContainerDied","Data":"db690f37a4a50d837090ddb10dd5ab680a8869f981897091be8b6921b1869f7e"} Jun 11 18:02:56.508804 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:56.508782 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp" Jun 11 18:02:57.505459 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:57.505416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" event={"ID":"2214479a-03ec-4372-9036-21c597923746","Type":"ContainerStarted","Data":"3bf493b78b1c47184781ad54b4676f683ef1ae14e6b23d4db0b397a8ca83cc1c"} Jun 11 18:02:57.524846 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:02:57.524785 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" podStartSLOduration=2.947077282 podStartE2EDuration="4.524769514s" totalImagesPullingTime="308.646476ms" totalInitContainerRuntime="1.269045756s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:02:57.521742057 +0000 UTC m=+933.615835563" watchObservedRunningTime="2026-06-11 18:02:57.524769514 +0000 UTC m=+933.618863020" Jun 11 18:03:04.256745 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:04.256712 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:03:04.257153 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:04.256793 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:03:04.269366 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:04.269342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:03:04.560292 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:04.560265 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw" Jun 11 18:03:05.935661 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:05.935622 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:03:12.837482 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:03:12.837442 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:04:37.326126 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:04:37.326088 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:04:41.730110 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:04:41.730077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:04:47.730502 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:04:47.730464 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:04:58.132334 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:04:58.132295 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:05:06.735527 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:05:06.735488 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:05:17.233947 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:05:17.233907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:05:26.044475 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:05:26.044436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:05:37.139777 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:05:37.139739 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:06:37.527386 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:06:37.527345 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:06:41.559787 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:06:41.559750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:07:02.783976 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:02.783899 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:07:11.642551 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:11.642514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:07:24.456349 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:24.456320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:07:24.458026 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:24.458004 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:07:28.527069 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:28.527036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:07:36.947006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:36.946969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:07:54.440237 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:07:54.440205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:08:02.435581 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:08:02.435545 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:08:35.630266 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:08:35.630228 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:08:44.526651 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:08:44.526611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:08:52.832560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:08:52.832521 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:09:00.440555 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:09:00.440521 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:09:08.834623 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:09:08.834585 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:09:34.532220 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:09:34.532184 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:09:45.130968 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:09:45.130887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:10:14.731836 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:10:14.731795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:10:17.225719 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:10:17.225686 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:10:33.931774 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:10:33.931742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:10:42.132344 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:10:42.132300 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:01.336775 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:01.336732 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:05.930471 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:05.930435 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:09.534654 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:09.534610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:18.430599 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:18.430562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:26.725391 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:26.725359 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:36.237841 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:36.237809 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:44.632549 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:44.632513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:11:53.935010 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:11:53.934975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:12:02.035318 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:12:02.035281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:12:10.531572 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:12:10.531536 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:12:18.832728 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:12:18.832689 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:12:24.500435 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:12:24.500408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:12:24.506002 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:12:24.505978 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:13:20.610991 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.610953 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 18:13:20.611500 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.611201 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" podUID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" containerName="manager" containerID="cri-o://2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc" gracePeriod=10 Jun 11 18:13:20.877320 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.877266 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 18:13:20.995733 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.995702 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume\") pod \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " Jun 11 18:13:20.995890 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.995812 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5lbk\" (UniqueName: \"kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk\") pod \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\" (UID: \"3645c5f6-db31-4bf1-a9ef-cb00feff910c\") " Jun 11 18:13:20.996062 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.996040 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3645c5f6-db31-4bf1-a9ef-cb00feff910c" (UID: "3645c5f6-db31-4bf1-a9ef-cb00feff910c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:13:20.997850 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:20.997830 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk" (OuterVolumeSpecName: "kube-api-access-d5lbk") pod "3645c5f6-db31-4bf1-a9ef-cb00feff910c" (UID: "3645c5f6-db31-4bf1-a9ef-cb00feff910c"). InnerVolumeSpecName "kube-api-access-d5lbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:13:21.096811 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.096784 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3645c5f6-db31-4bf1-a9ef-cb00feff910c-extensions-socket-volume\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:13:21.096811 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.096808 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5lbk\" (UniqueName: \"kubernetes.io/projected/3645c5f6-db31-4bf1-a9ef-cb00feff910c-kube-api-access-d5lbk\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:13:21.277832 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.277802 2574 generic.go:356] "Generic (PLEG): container finished" podID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" containerID="2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc" exitCode=0 Jun 11 18:13:21.277992 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.277850 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" Jun 11 18:13:21.277992 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.277894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" event={"ID":"3645c5f6-db31-4bf1-a9ef-cb00feff910c","Type":"ContainerDied","Data":"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc"} Jun 11 18:13:21.277992 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.277945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q" event={"ID":"3645c5f6-db31-4bf1-a9ef-cb00feff910c","Type":"ContainerDied","Data":"2b06c6b597d4f28ccd947f47fd798f6bbfb31c69a8287c4feff4b10a7ed5db1e"} Jun 11 18:13:21.277992 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.277966 2574 scope.go:117] "RemoveContainer" containerID="2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc" Jun 11 18:13:21.288596 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.288578 2574 scope.go:117] "RemoveContainer" containerID="2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc" Jun 11 18:13:21.288859 ip-10-0-133-204 kubenswrapper[2574]: E0611 18:13:21.288837 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc\": container with ID starting with 2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc not found: ID does not exist" containerID="2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc" Jun 11 18:13:21.288954 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.288862 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc"} err="failed to get container status \"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc\": rpc error: code = NotFound desc = could not find container \"2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc\": container with ID starting with 2b8680621a60419e79b51733d3220b555429638a7c2bde86452aecd594f41bdc not found: ID does not exist" Jun 11 18:13:21.301907 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.301885 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 18:13:21.305709 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:21.305688 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2974q"] Jun 11 18:13:22.376202 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:13:22.376151 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" path="/var/lib/kubelet/pods/3645c5f6-db31-4bf1-a9ef-cb00feff910c/volumes" Jun 11 18:14:48.688167 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:14:48.688133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:14:53.588115 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:14:53.588078 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:15:00.137338 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.137302 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686695-rxqc5"] Jun 11 18:15:00.137779 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.137763 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" containerName="manager" Jun 11 18:15:00.137825 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.137781 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" containerName="manager" Jun 11 18:15:00.137877 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.137868 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3645c5f6-db31-4bf1-a9ef-cb00feff910c" containerName="manager" Jun 11 18:15:00.141119 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.141104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:00.144021 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.143999 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-65bck\"" Jun 11 18:15:00.147537 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.147513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686695-rxqc5"] Jun 11 18:15:00.291198 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.291140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwhh9\" (UniqueName: \"kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9\") pod \"maas-api-key-cleanup-29686695-rxqc5\" (UID: \"c77eb618-59cf-4548-b878-763e39b12d7a\") " pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:00.392189 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.392088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwhh9\" (UniqueName: \"kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9\") pod \"maas-api-key-cleanup-29686695-rxqc5\" (UID: \"c77eb618-59cf-4548-b878-763e39b12d7a\") " pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:00.400652 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.400627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwhh9\" (UniqueName: \"kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9\") pod \"maas-api-key-cleanup-29686695-rxqc5\" (UID: \"c77eb618-59cf-4548-b878-763e39b12d7a\") " pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:00.454129 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.454105 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:00.589874 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.589835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686695-rxqc5"] Jun 11 18:15:00.590792 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:15:00.590762 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77eb618_59cf_4548_b878_763e39b12d7a.slice/crio-53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd WatchSource:0}: Error finding container 53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd: Status 404 returned error can't find the container with id 53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd Jun 11 18:15:00.592799 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.592782 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:15:00.879393 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:00.879358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" event={"ID":"c77eb618-59cf-4548-b878-763e39b12d7a","Type":"ContainerStarted","Data":"53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd"} Jun 11 18:15:03.900199 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:03.900145 2574 generic.go:356] "Generic (PLEG): container finished" podID="c77eb618-59cf-4548-b878-763e39b12d7a" containerID="ae5e441f07c60e58bf131e5c1415502dbe8038d52b97d8573c75b0c67de1bfde" exitCode=0 Jun 11 18:15:03.900485 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:03.900217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" event={"ID":"c77eb618-59cf-4548-b878-763e39b12d7a","Type":"ContainerDied","Data":"ae5e441f07c60e58bf131e5c1415502dbe8038d52b97d8573c75b0c67de1bfde"} Jun 11 18:15:05.040780 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.040757 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:05.235399 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.235369 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwhh9\" (UniqueName: \"kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9\") pod \"c77eb618-59cf-4548-b878-763e39b12d7a\" (UID: \"c77eb618-59cf-4548-b878-763e39b12d7a\") " Jun 11 18:15:05.237615 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.237583 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9" (OuterVolumeSpecName: "kube-api-access-jwhh9") pod "c77eb618-59cf-4548-b878-763e39b12d7a" (UID: "c77eb618-59cf-4548-b878-763e39b12d7a"). InnerVolumeSpecName "kube-api-access-jwhh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:15:05.337147 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.337112 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwhh9\" (UniqueName: \"kubernetes.io/projected/c77eb618-59cf-4548-b878-763e39b12d7a-kube-api-access-jwhh9\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:15:05.914331 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.914304 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" Jun 11 18:15:05.914501 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.914344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686695-rxqc5" event={"ID":"c77eb618-59cf-4548-b878-763e39b12d7a","Type":"ContainerDied","Data":"53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd"} Jun 11 18:15:05.914501 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:05.914389 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53e132426df49a119711556a9cca227bbf8210dfae22a7ca191f413856bd02bd" Jun 11 18:15:19.091541 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:19.091501 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:15:24.095766 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:24.095731 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:15:31.555861 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:31.555828 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:15:41.797022 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:41.796989 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:15:50.697525 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:15:50.697445 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:01.492366 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:01.492334 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:10.094384 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:10.094342 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:20.686079 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:20.686043 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:29.597551 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:29.597510 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:40.491726 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:40.491690 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:48.701851 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:48.701819 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:16:52.949712 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:16:52.949678 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:17:24.090983 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:17:24.090947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:17:24.541716 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:17:24.541692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:17:24.549461 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:17:24.549435 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:18:07.088024 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:07.087977 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:18:15.693932 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:15.693893 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:18:24.197461 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:24.197420 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:18:33.184904 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:33.184854 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:18:41.591850 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:41.591813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:18:54.092018 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:18:54.091943 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:02.917399 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:02.917362 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:08.588833 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:08.588798 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:15.497332 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:15.497295 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:23.680136 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:23.680104 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:31.896230 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:31.896196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:19:42.387300 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:19:42.387260 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:00.295705 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:00.295667 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:09.284514 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:09.284479 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:17.590236 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:17.590200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:25.890693 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:25.890649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:43.192542 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:43.192501 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:20:50.783736 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:20:50.783702 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:00.296198 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:00.296148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:08.887450 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:08.887416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:17.586356 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:17.586319 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:26.782041 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:26.782003 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:35.092581 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:35.092545 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:45.982407 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:45.982316 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:21:55.090846 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:21:55.090806 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:05.987779 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:05.987745 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:15.294502 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:15.294467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:20.396042 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:20.396002 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:24.585511 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:24.585475 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:22:24.595609 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:24.595590 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:22:27.584552 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:27.584513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:33.394167 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:33.394129 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:47.587932 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:47.587900 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:22:56.196824 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:22:56.196786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:05.589859 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:05.589824 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:11.090330 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:11.090293 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:35.499882 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:35.499844 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:47.196307 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:47.196273 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:48.599275 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.599153 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:23:48.599703 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.599688 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77eb618-59cf-4548-b878-763e39b12d7a" containerName="cleanup" Jun 11 18:23:48.599747 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.599706 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77eb618-59cf-4548-b878-763e39b12d7a" containerName="cleanup" Jun 11 18:23:48.599808 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.599799 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77eb618-59cf-4548-b878-763e39b12d7a" containerName="cleanup" Jun 11 18:23:48.603127 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.603106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.605918 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.605897 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f77336d5-openshift-default-dockercfg-slq82\"" Jun 11 18:23:48.610430 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610558 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610558 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610691 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610754 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610754 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610860 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hvv\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.610918 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.611321 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.610919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.620737 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.620712 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:23:48.711512 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hvv\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.711697 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.712040 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.712040 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.712040 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.711963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.712302 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.712269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.712991 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.712932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.713603 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.713576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.713843 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.713824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.714745 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.714720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.715230 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.715207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.720067 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.720039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.720270 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.720253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hvv\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv\") pod \"e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:48.914827 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:48.914738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:49.055857 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:49.055829 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:23:49.056854 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:23:49.056821 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecf5451_f208_4b4f_9119_8467c583bac2.slice/crio-e5cf15eb2a655e7d02786b551204f9216f54f9452a58d40d483d177bcb73989b WatchSource:0}: Error finding container e5cf15eb2a655e7d02786b551204f9216f54f9452a58d40d483d177bcb73989b: Status 404 returned error can't find the container with id e5cf15eb2a655e7d02786b551204f9216f54f9452a58d40d483d177bcb73989b Jun 11 18:23:49.058886 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:49.058870 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:23:49.075549 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:49.075519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" event={"ID":"5ecf5451-f208-4b4f-9119-8467c583bac2","Type":"ContainerStarted","Data":"e5cf15eb2a655e7d02786b551204f9216f54f9452a58d40d483d177bcb73989b"} Jun 11 18:23:51.671712 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:51.671673 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:23:51.672006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:51.671749 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:23:51.672006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:51.671785 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:23:52.098882 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:52.098846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" event={"ID":"5ecf5451-f208-4b4f-9119-8467c583bac2","Type":"ContainerStarted","Data":"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614"} Jun 11 18:23:52.121302 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:52.121251 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" podStartSLOduration=1.5088968600000001 podStartE2EDuration="4.121237396s" totalImagesPullingTime="2.612340536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:23:52.118302366 +0000 UTC m=+2188.212395876" watchObservedRunningTime="2026-06-11 18:23:52.121237396 +0000 UTC m=+2188.215330955" Jun 11 18:23:52.915217 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:52.915156 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:52.920423 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:52.920402 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:53.104733 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:53.104701 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:53.105788 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:53.105770 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:23:53.588253 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:53.588133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:23:55.013703 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:55.013665 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:23:55.117008 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:55.116970 2574 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" secret="" err="secret \"e2e-ait-f77336d5-openshift-default-dockercfg-slq82\" not found" Jun 11 18:23:56.123301 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:23:56.123231 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" podUID="5ecf5451-f208-4b4f-9119-8467c583bac2" containerName="istio-proxy" containerID="cri-o://b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614" gracePeriod=30 Jun 11 18:24:01.400670 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.400645 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:24:01.438051 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438013 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438228 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438096 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438228 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438166 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438228 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438401 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438247 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438401 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438275 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438401 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438296 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438401 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438320 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7hvv\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438401 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438354 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs\") pod \"5ecf5451-f208-4b4f-9119-8467c583bac2\" (UID: \"5ecf5451-f208-4b4f-9119-8467c583bac2\") " Jun 11 18:24:01.438652 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438593 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:01.438724 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438704 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:01.438783 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438717 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:01.438842 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438801 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:24:01.438895 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438886 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5451-f208-4b4f-9119-8467c583bac2-istiod-ca-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.438946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438900 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-data\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.438946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438918 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.438946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.438937 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-workload-certs\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.439104 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.439070 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:01.440802 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.440773 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv" (OuterVolumeSpecName: "kube-api-access-k7hvv") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "kube-api-access-k7hvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:24:01.440899 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.440849 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 18:24:01.440899 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.440863 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:24:01.441033 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.441011 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ecf5451-f208-4b4f-9119-8467c583bac2" (UID: "5ecf5451-f208-4b4f-9119-8467c583bac2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:01.539858 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.539832 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-envoy\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.539858 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.539855 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-token\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.539858 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.539863 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5451-f208-4b4f-9119-8467c583bac2-istio-podinfo\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.540076 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.539872 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5451-f208-4b4f-9119-8467c583bac2-credential-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:01.540076 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:01.539882 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7hvv\" (UniqueName: \"kubernetes.io/projected/5ecf5451-f208-4b4f-9119-8467c583bac2-kube-api-access-k7hvv\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:02.162049 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.162010 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ecf5451-f208-4b4f-9119-8467c583bac2" containerID="b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614" exitCode=0 Jun 11 18:24:02.162258 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.162069 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" Jun 11 18:24:02.162258 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.162105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" event={"ID":"5ecf5451-f208-4b4f-9119-8467c583bac2","Type":"ContainerDied","Data":"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614"} Jun 11 18:24:02.162258 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.162212 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt" event={"ID":"5ecf5451-f208-4b4f-9119-8467c583bac2","Type":"ContainerDied","Data":"e5cf15eb2a655e7d02786b551204f9216f54f9452a58d40d483d177bcb73989b"} Jun 11 18:24:02.162258 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.162237 2574 scope.go:117] "RemoveContainer" containerID="b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614" Jun 11 18:24:02.172913 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.172898 2574 scope.go:117] "RemoveContainer" containerID="b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614" Jun 11 18:24:02.173238 ip-10-0-133-204 kubenswrapper[2574]: E0611 18:24:02.173212 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614\": container with ID starting with b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614 not found: ID does not exist" containerID="b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614" Jun 11 18:24:02.173316 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.173252 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614"} err="failed to get container status \"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614\": rpc error: code = NotFound desc = could not find container \"b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614\": container with ID starting with b73efdc17357cd10e7cc7f0a80c16d9ac1691f4282b66458bbaad6ba92c59614 not found: ID does not exist" Jun 11 18:24:02.185060 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.185033 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:24:02.187905 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.187880 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f77336d5-openshift-default-949bddc76-xlzdt"] Jun 11 18:24:02.377736 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:02.377705 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ecf5451-f208-4b4f-9119-8467c583bac2" path="/var/lib/kubelet/pods/5ecf5451-f208-4b4f-9119-8467c583bac2/volumes" Jun 11 18:24:14.638254 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.638220 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:14.638731 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.638676 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecf5451-f208-4b4f-9119-8467c583bac2" containerName="istio-proxy" Jun 11 18:24:14.638731 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.638689 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecf5451-f208-4b4f-9119-8467c583bac2" containerName="istio-proxy" Jun 11 18:24:14.638862 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.638771 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecf5451-f208-4b4f-9119-8467c583bac2" containerName="istio-proxy" Jun 11 18:24:14.643625 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.643606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.646301 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.646276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-invalid-a8a5c15c-openshift-default-dockercfg-5qrk4\"" Jun 11 18:24:14.654273 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.654249 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:14.774059 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774251 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774251 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774251 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774251 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774251 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjnq5\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774467 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774467 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.774467 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.774326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.874910 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.874876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875089 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.874919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjnq5\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875089 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.874944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875089 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.874965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875089 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875354 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875354 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875354 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875354 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875558 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875558 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875706 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.875833 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.876011 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.875994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.877374 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.877351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.877752 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.877737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.883026 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.883003 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.883487 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.883464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjnq5\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5\") pod \"e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:14.956694 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:14.956664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:15.106282 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.106254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:15.106560 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:24:15.106537 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c3d6f6_99be_44f9_b9f0_98595a1ed427.slice/crio-b460af6af741350cbeb5b25d08a02af411b3fd7e271f29a7b1fc884b71622bb8 WatchSource:0}: Error finding container b460af6af741350cbeb5b25d08a02af411b3fd7e271f29a7b1fc884b71622bb8: Status 404 returned error can't find the container with id b460af6af741350cbeb5b25d08a02af411b3fd7e271f29a7b1fc884b71622bb8 Jun 11 18:24:15.108490 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.108462 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:24:15.108550 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.108521 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:24:15.108587 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.108553 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:24:15.222216 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.222123 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:15.245678 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.245639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" event={"ID":"a7c3d6f6-99be-44f9-b9f0-98595a1ed427","Type":"ContainerStarted","Data":"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d"} Jun 11 18:24:15.245837 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.245707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" event={"ID":"a7c3d6f6-99be-44f9-b9f0-98595a1ed427","Type":"ContainerStarted","Data":"b460af6af741350cbeb5b25d08a02af411b3fd7e271f29a7b1fc884b71622bb8"} Jun 11 18:24:15.245904 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.245876 2574 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" secret="" err="secret \"e2e-invalid-a8a5c15c-openshift-default-dockercfg-5qrk4\" not found" Jun 11 18:24:15.271611 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.271548 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" podStartSLOduration=1.2715214289999999 podStartE2EDuration="1.271521429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:24:15.266565073 +0000 UTC m=+2211.360658580" watchObservedRunningTime="2026-06-11 18:24:15.271521429 +0000 UTC m=+2211.365614936" Jun 11 18:24:15.957608 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:15.957578 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:16.251847 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:16.251748 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" podUID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" containerName="istio-proxy" containerID="cri-o://f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d" gracePeriod=30 Jun 11 18:24:21.513271 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.513204 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:21.639470 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639443 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639482 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639501 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639529 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639561 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639594 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.639679 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639664 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjnq5\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.640006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639706 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.640006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639752 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket\") pod \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\" (UID: \"a7c3d6f6-99be-44f9-b9f0-98595a1ed427\") " Jun 11 18:24:21.640006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639867 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:21.640006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639979 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:24:21.640006 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.639998 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:21.640268 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.640146 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:21.640268 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.640203 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istiod-ca-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.640268 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.640220 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-data\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.640268 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.640231 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-certs\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.640430 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.640274 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:21.641942 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.641915 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:24:21.642059 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.641972 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5" (OuterVolumeSpecName: "kube-api-access-mjnq5") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "kube-api-access-mjnq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:24:21.642059 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.642030 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:24:21.642137 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.642090 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7c3d6f6-99be-44f9-b9f0-98595a1ed427" (UID: "a7c3d6f6-99be-44f9-b9f0-98595a1ed427"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 18:24:21.740915 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740878 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjnq5\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-kube-api-access-mjnq5\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.740915 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740911 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-podinfo\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.741094 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740922 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-workload-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.741094 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740932 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-token\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.741094 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740940 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-istio-envoy\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:21.741094 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:21.740947 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7c3d6f6-99be-44f9-b9f0-98595a1ed427-credential-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:24:22.290459 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.290426 2574 generic.go:356] "Generic (PLEG): container finished" podID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" containerID="f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d" exitCode=0 Jun 11 18:24:22.290636 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.290477 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" Jun 11 18:24:22.290636 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.290513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" event={"ID":"a7c3d6f6-99be-44f9-b9f0-98595a1ed427","Type":"ContainerDied","Data":"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d"} Jun 11 18:24:22.290636 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.290577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z" event={"ID":"a7c3d6f6-99be-44f9-b9f0-98595a1ed427","Type":"ContainerDied","Data":"b460af6af741350cbeb5b25d08a02af411b3fd7e271f29a7b1fc884b71622bb8"} Jun 11 18:24:22.290636 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.290600 2574 scope.go:117] "RemoveContainer" containerID="f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d" Jun 11 18:24:22.301025 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.301003 2574 scope.go:117] "RemoveContainer" containerID="f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d" Jun 11 18:24:22.301314 ip-10-0-133-204 kubenswrapper[2574]: E0611 18:24:22.301294 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d\": container with ID starting with f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d not found: ID does not exist" containerID="f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d" Jun 11 18:24:22.301393 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.301326 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d"} err="failed to get container status \"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d\": rpc error: code = NotFound desc = could not find container \"f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d\": container with ID starting with f7f41441b4c1851ff082af8267e56967dd15656bd1e5cc065870d16dabec9c6d not found: ID does not exist" Jun 11 18:24:22.314523 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.314499 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:22.318983 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.318963 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-invalid-a8a5c15c-openshift-default-65b6fc845d-6864z"] Jun 11 18:24:22.384292 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:24:22.384262 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" path="/var/lib/kubelet/pods/a7c3d6f6-99be-44f9-b9f0-98595a1ed427/volumes" Jun 11 18:25:43.591621 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:43.591583 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:25:48.387523 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:48.387482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:25:51.787801 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:51.787763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:25:57.115055 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.115014 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:25:57.115544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.115468 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" containerName="istio-proxy" Jun 11 18:25:57.115544 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.115481 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" containerName="istio-proxy" Jun 11 18:25:57.115678 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.115557 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c3d6f6-99be-44f9-b9f0-98595a1ed427" containerName="istio-proxy" Jun 11 18:25:57.118718 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.118697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.121951 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.121933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0eb1ae77-openshift-default-dockercfg-lbxnx\"" Jun 11 18:25:57.138743 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.138721 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:25:57.259522 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259682 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259682 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-497dk\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259682 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259682 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259682 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259849 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259849 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.259849 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.259767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361215 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361215 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361464 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361464 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361464 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-497dk\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361464 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361464 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361700 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361700 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361527 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361700 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361864 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361932 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.361992 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.361970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.362039 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.362028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.363711 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.363692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.363906 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.363889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.369212 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.369144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-497dk\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.369212 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.369167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token\") pod \"e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.430258 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.430228 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:57.568985 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.568959 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:25:57.569582 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:25:57.569553 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode468ef95_d16a_41b0_9b49_e456976d8131.slice/crio-610e29684eb07245055089c3ec94ed89c54deb2d1e67935a6fa22797f3079585 WatchSource:0}: Error finding container 610e29684eb07245055089c3ec94ed89c54deb2d1e67935a6fa22797f3079585: Status 404 returned error can't find the container with id 610e29684eb07245055089c3ec94ed89c54deb2d1e67935a6fa22797f3079585 Jun 11 18:25:57.572005 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.571965 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:25:57.572082 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.572045 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:25:57.572121 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.572085 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:25:57.884098 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.884002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" event={"ID":"e468ef95-d16a-41b0-9b49-e456976d8131","Type":"ContainerStarted","Data":"5410ab34a3115b375e0707e6272ae30faac99a1fd2a02d492025e7a2c03c536a"} Jun 11 18:25:57.884098 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.884057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" event={"ID":"e468ef95-d16a-41b0-9b49-e456976d8131","Type":"ContainerStarted","Data":"610e29684eb07245055089c3ec94ed89c54deb2d1e67935a6fa22797f3079585"} Jun 11 18:25:57.908775 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:57.908716 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" podStartSLOduration=0.908700426 podStartE2EDuration="908.700426ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:25:57.905210767 +0000 UTC m=+2313.999304275" watchObservedRunningTime="2026-06-11 18:25:57.908700426 +0000 UTC m=+2314.002793932" Jun 11 18:25:58.430948 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:58.430919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:58.432470 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:58.432446 2574 patch_prober.go:28] interesting pod/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jun 11 18:25:58.432579 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:58.432492 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jun 11 18:25:59.434263 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:59.434228 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:59.897363 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:59.897282 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:25:59.898282 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:25:59.898261 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:26:16.810559 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:16.810523 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:26:16.811108 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:16.810753 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" containerName="istio-proxy" containerID="cri-o://5410ab34a3115b375e0707e6272ae30faac99a1fd2a02d492025e7a2c03c536a" gracePeriod=30 Jun 11 18:26:22.032535 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.032504 2574 generic.go:356] "Generic (PLEG): container finished" podID="e468ef95-d16a-41b0-9b49-e456976d8131" containerID="5410ab34a3115b375e0707e6272ae30faac99a1fd2a02d492025e7a2c03c536a" exitCode=0 Jun 11 18:26:22.032903 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.032576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" event={"ID":"e468ef95-d16a-41b0-9b49-e456976d8131","Type":"ContainerDied","Data":"5410ab34a3115b375e0707e6272ae30faac99a1fd2a02d492025e7a2c03c536a"} Jun 11 18:26:22.078045 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.077984 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:26:22.188458 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188423 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188458 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188459 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188683 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188525 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188683 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188555 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-497dk\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188683 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188581 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188683 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188595 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188683 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188653 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188685 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188716 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy\") pod \"e468ef95-d16a-41b0-9b49-e456976d8131\" (UID: \"e468ef95-d16a-41b0-9b49-e456976d8131\") " Jun 11 18:26:22.188946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188835 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:26:22.188946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188858 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:26:22.188946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188867 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.188954 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data" (OuterVolumeSpecName: "istio-data") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.189095 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-credential-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.189115 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.189131 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-data\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.189144 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-workload-certs\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.189231 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.189139 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:26:22.190909 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.190878 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:26:22.191008 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.190911 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 18:26:22.191133 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.191120 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token" (OuterVolumeSpecName: "istio-token") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:26:22.191201 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.191148 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk" (OuterVolumeSpecName: "kube-api-access-497dk") pod "e468ef95-d16a-41b0-9b49-e456976d8131" (UID: "e468ef95-d16a-41b0-9b49-e456976d8131"). InnerVolumeSpecName "kube-api-access-497dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:26:22.289793 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.289751 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-497dk\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-kube-api-access-497dk\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.289793 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.289784 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e468ef95-d16a-41b0-9b49-e456976d8131-istio-podinfo\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.289793 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.289796 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e468ef95-d16a-41b0-9b49-e456976d8131-istiod-ca-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.289793 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.289805 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e468ef95-d16a-41b0-9b49-e456976d8131-istio-envoy\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:22.290065 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:22.289814 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e468ef95-d16a-41b0-9b49-e456976d8131-istio-token\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:26:23.040002 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:23.039965 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" event={"ID":"e468ef95-d16a-41b0-9b49-e456976d8131","Type":"ContainerDied","Data":"610e29684eb07245055089c3ec94ed89c54deb2d1e67935a6fa22797f3079585"} Jun 11 18:26:23.040002 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:23.040002 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8" Jun 11 18:26:23.040478 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:23.040041 2574 scope.go:117] "RemoveContainer" containerID="5410ab34a3115b375e0707e6272ae30faac99a1fd2a02d492025e7a2c03c536a" Jun 11 18:26:23.063226 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:23.063199 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:26:23.070663 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:23.070621 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0eb1ae77-openshift-default-666bd9d57d-48pg8"] Jun 11 18:26:24.378351 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:24.378319 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" path="/var/lib/kubelet/pods/e468ef95-d16a-41b0-9b49-e456976d8131/volumes" Jun 11 18:26:39.727427 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.727389 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:26:39.728045 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.728027 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" containerName="istio-proxy" Jun 11 18:26:39.728133 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.728050 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" containerName="istio-proxy" Jun 11 18:26:39.728229 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.728216 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e468ef95-d16a-41b0-9b49-e456976d8131" containerName="istio-proxy" Jun 11 18:26:39.731698 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.731681 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.734346 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.734325 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d8f14cff-openshift-default-dockercfg-qc54f\"" Jun 11 18:26:39.741267 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.741240 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:26:39.850044 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850044 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850290 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850290 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5lf\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850290 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850290 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850290 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850469 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.850469 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.850379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951297 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5lf\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951795 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951795 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951795 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951705 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951953 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.951953 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.951887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.952080 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.952061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.952217 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.952195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.953785 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.953764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.953902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.953854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.959192 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.959149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:39.959285 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:39.959267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5lf\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf\") pod \"e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:40.044830 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:40.044758 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:40.194763 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:40.194733 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:26:40.194911 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:26:40.194863 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f15b41_2ed3_4981_8a82_8054cec36f0e.slice/crio-8058cf9784b9996c132a4f6fa33cf0bc55a05a96a512db4399f10bd39800f5de WatchSource:0}: Error finding container 8058cf9784b9996c132a4f6fa33cf0bc55a05a96a512db4399f10bd39800f5de: Status 404 returned error can't find the container with id 8058cf9784b9996c132a4f6fa33cf0bc55a05a96a512db4399f10bd39800f5de Jun 11 18:26:40.196960 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:40.196935 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:26:40.197063 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:40.196988 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:26:40.197063 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:40.197021 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 18:26:41.152359 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:41.152317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" event={"ID":"82f15b41-2ed3-4981-8a82-8054cec36f0e","Type":"ContainerStarted","Data":"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b"} Jun 11 18:26:41.152747 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:41.152417 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" event={"ID":"82f15b41-2ed3-4981-8a82-8054cec36f0e","Type":"ContainerStarted","Data":"8058cf9784b9996c132a4f6fa33cf0bc55a05a96a512db4399f10bd39800f5de"} Jun 11 18:26:41.174983 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:41.174932 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" podStartSLOduration=2.174918319 podStartE2EDuration="2.174918319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:26:41.173101393 +0000 UTC m=+2357.267194900" watchObservedRunningTime="2026-06-11 18:26:41.174918319 +0000 UTC m=+2357.269011803" Jun 11 18:26:42.045894 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:42.045860 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:42.050692 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:42.050668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:42.158135 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:42.158106 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:26:42.159183 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:26:42.159156 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:27:24.633722 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:27:24.633694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:27:24.645105 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:27:24.645065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:28:56.188458 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:28:56.188417 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:28:56.189034 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:28:56.188696 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerName="istio-proxy" containerID="cri-o://d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b" gracePeriod=30 Jun 11 18:28:57.160355 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:28:57.160317 2574 patch_prober.go:28] interesting pod/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 18:28:57.160539 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:28:57.160390 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:28:57.291053 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:28:57.291017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:29:01.449961 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.449904 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:29:01.558815 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.558772 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.558976 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.558847 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.558976 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.558877 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j5lf\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.558976 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.558916 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559155 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559037 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:29:01.559155 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559041 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559155 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559107 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559155 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559144 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559415 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559157 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:29:01.559415 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559200 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559415 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559265 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data\") pod \"82f15b41-2ed3-4981-8a82-8054cec36f0e\" (UID: \"82f15b41-2ed3-4981-8a82-8054cec36f0e\") " Jun 11 18:29:01.559415 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:29:01.559623 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559481 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:29:01.559623 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559597 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:29:01.559836 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559815 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-data\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.559902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559843 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-certs\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.559902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559856 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-workload-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.559902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559869 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f15b41-2ed3-4981-8a82-8054cec36f0e-istiod-ca-cert\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.559902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.559882 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-credential-socket\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.561285 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.561254 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf" (OuterVolumeSpecName: "kube-api-access-2j5lf") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "kube-api-access-2j5lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:29:01.561285 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.561259 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:29:01.561479 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.561462 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:29:01.561479 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.561469 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82f15b41-2ed3-4981-8a82-8054cec36f0e" (UID: "82f15b41-2ed3-4981-8a82-8054cec36f0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 18:29:01.661278 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.661239 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-podinfo\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.661278 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.661273 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j5lf\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-kube-api-access-2j5lf\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.661278 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.661283 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-token\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:01.661278 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:01.661292 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f15b41-2ed3-4981-8a82-8054cec36f0e-istio-envoy\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:29:02.024076 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.024041 2574 generic.go:356] "Generic (PLEG): container finished" podID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerID="d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b" exitCode=0 Jun 11 18:29:02.024270 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.024083 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" Jun 11 18:29:02.024270 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.024129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" event={"ID":"82f15b41-2ed3-4981-8a82-8054cec36f0e","Type":"ContainerDied","Data":"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b"} Jun 11 18:29:02.024270 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.024197 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5" event={"ID":"82f15b41-2ed3-4981-8a82-8054cec36f0e","Type":"ContainerDied","Data":"8058cf9784b9996c132a4f6fa33cf0bc55a05a96a512db4399f10bd39800f5de"} Jun 11 18:29:02.024270 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.024223 2574 scope.go:117] "RemoveContainer" containerID="d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b" Jun 11 18:29:02.039077 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.039057 2574 scope.go:117] "RemoveContainer" containerID="d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b" Jun 11 18:29:02.039357 ip-10-0-133-204 kubenswrapper[2574]: E0611 18:29:02.039336 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b\": container with ID starting with d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b not found: ID does not exist" containerID="d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b" Jun 11 18:29:02.039444 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.039362 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b"} err="failed to get container status \"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b\": rpc error: code = NotFound desc = could not find container \"d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b\": container with ID starting with d27fba73000442bddd3369a31d3f35db9b441bff7e662d081fc3f6b21388809b not found: ID does not exist" Jun 11 18:29:02.049638 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.049614 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:29:02.052487 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.052469 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d8f14cff-openshift-default-784f5bbbfd-b8tp5"] Jun 11 18:29:02.376408 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:02.376329 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" path="/var/lib/kubelet/pods/82f15b41-2ed3-4981-8a82-8054cec36f0e/volumes" Jun 11 18:29:03.882608 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:03.882571 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:29:07.389370 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:29:07.389283 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2lhln"] Jun 11 18:30:00.139130 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.139093 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686710-gtc62"] Jun 11 18:30:00.141499 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.139558 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerName="istio-proxy" Jun 11 18:30:00.141499 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.139572 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerName="istio-proxy" Jun 11 18:30:00.141499 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.139660 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f15b41-2ed3-4981-8a82-8054cec36f0e" containerName="istio-proxy" Jun 11 18:30:00.142605 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.142590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:00.145805 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.145780 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-65bck\"" Jun 11 18:30:00.149321 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.149290 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686710-gtc62"] Jun 11 18:30:00.191902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.191866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqxhd\" (UniqueName: \"kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd\") pod \"maas-api-key-cleanup-29686710-gtc62\" (UID: \"8f792764-05d2-4497-b771-9c01881e68f9\") " pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:00.292849 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.292804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqxhd\" (UniqueName: \"kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd\") pod \"maas-api-key-cleanup-29686710-gtc62\" (UID: \"8f792764-05d2-4497-b771-9c01881e68f9\") " pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:00.302326 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.302291 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqxhd\" (UniqueName: \"kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd\") pod \"maas-api-key-cleanup-29686710-gtc62\" (UID: \"8f792764-05d2-4497-b771-9c01881e68f9\") " pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:00.455387 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.455358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:00.592526 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:00.592495 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686710-gtc62"] Jun 11 18:30:00.593333 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:30:00.593291 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f792764_05d2_4497_b771_9c01881e68f9.slice/crio-b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8 WatchSource:0}: Error finding container b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8: Status 404 returned error can't find the container with id b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8 Jun 11 18:30:01.406636 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:01.406595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" event={"ID":"8f792764-05d2-4497-b771-9c01881e68f9","Type":"ContainerStarted","Data":"1c826e907af945114e0aa8165aabd58ff0393b19aa1b90a3b965beaacc24c634"} Jun 11 18:30:01.407032 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:01.406659 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" event={"ID":"8f792764-05d2-4497-b771-9c01881e68f9","Type":"ContainerStarted","Data":"b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8"} Jun 11 18:30:01.423009 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:01.422962 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" podStartSLOduration=1.422945773 podStartE2EDuration="1.422945773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:30:01.421472241 +0000 UTC m=+2557.515565748" watchObservedRunningTime="2026-06-11 18:30:01.422945773 +0000 UTC m=+2557.517039278" Jun 11 18:30:02.413702 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:02.413672 2574 generic.go:356] "Generic (PLEG): container finished" podID="8f792764-05d2-4497-b771-9c01881e68f9" containerID="1c826e907af945114e0aa8165aabd58ff0393b19aa1b90a3b965beaacc24c634" exitCode=0 Jun 11 18:30:02.414077 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:02.413759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" event={"ID":"8f792764-05d2-4497-b771-9c01881e68f9","Type":"ContainerDied","Data":"1c826e907af945114e0aa8165aabd58ff0393b19aa1b90a3b965beaacc24c634"} Jun 11 18:30:03.552621 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:03.552593 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:03.619342 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:03.619314 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqxhd\" (UniqueName: \"kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd\") pod \"8f792764-05d2-4497-b771-9c01881e68f9\" (UID: \"8f792764-05d2-4497-b771-9c01881e68f9\") " Jun 11 18:30:03.621323 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:03.621300 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd" (OuterVolumeSpecName: "kube-api-access-cqxhd") pod "8f792764-05d2-4497-b771-9c01881e68f9" (UID: "8f792764-05d2-4497-b771-9c01881e68f9"). InnerVolumeSpecName "kube-api-access-cqxhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:30:03.720105 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:03.720081 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqxhd\" (UniqueName: \"kubernetes.io/projected/8f792764-05d2-4497-b771-9c01881e68f9-kube-api-access-cqxhd\") on node \"ip-10-0-133-204.ec2.internal\" DevicePath \"\"" Jun 11 18:30:04.427761 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:04.427730 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" Jun 11 18:30:04.427761 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:04.427745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686710-gtc62" event={"ID":"8f792764-05d2-4497-b771-9c01881e68f9","Type":"ContainerDied","Data":"b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8"} Jun 11 18:30:04.427965 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:30:04.427794 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b14b9c1586cb48c863fc25906cd2208c334415e8c982eb523f679518ab9e82e8" Jun 11 18:32:24.675866 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:32:24.675834 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:32:24.688482 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:32:24.688456 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:33:39.380891 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:39.380857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7986cb5f7-lg9bv_5c1dc3fb-6eb1-4833-80aa-e85f5bc32636/nginx/0.log" Jun 11 18:33:39.623294 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:39.623254 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8gkfp_fb3cad0a-cf20-429f-befe-9af3b217eee1/manager/0.log" Jun 11 18:33:39.744864 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:39.744831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gtn7k_0c08aa41-962b-4f0b-918d-297933470d4b/manager/0.log" Jun 11 18:33:40.087658 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.087578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686695-rxqc5_c77eb618-59cf-4548-b878-763e39b12d7a/cleanup/0.log" Jun 11 18:33:40.198821 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.198786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686710-gtc62_8f792764-05d2-4497-b771-9c01881e68f9/cleanup/0.log" Jun 11 18:33:40.435604 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.435578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2bdph_6c307435-4e51-4b4a-b246-f963b7919167/server/0.log" Jun 11 18:33:40.559089 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.559057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-djh2s_b5a275e5-c68f-4f7d-97e8-87647961e03a/manager/0.log" Jun 11 18:33:40.925434 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.925358 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfd79d7d-lx7cd_1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5/copy-manifests/0.log" Jun 11 18:33:40.932427 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:40.932407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfd79d7d-lx7cd_1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5/manager/0.log" Jun 11 18:33:41.795334 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.795308 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/util/0.log" Jun 11 18:33:41.802178 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.802150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/pull/0.log" Jun 11 18:33:41.809121 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.809103 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/extract/0.log" Jun 11 18:33:41.919747 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.919723 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/util/0.log" Jun 11 18:33:41.926349 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.926326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/pull/0.log" Jun 11 18:33:41.931984 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:41.931967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/extract/0.log" Jun 11 18:33:42.040158 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.040134 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/util/0.log" Jun 11 18:33:42.046564 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.046502 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/pull/0.log" Jun 11 18:33:42.052750 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.052726 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/extract/0.log" Jun 11 18:33:42.158122 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.158090 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/util/0.log" Jun 11 18:33:42.164344 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.164318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/pull/0.log" Jun 11 18:33:42.172602 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.172579 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/extract/0.log" Jun 11 18:33:42.515803 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.515776 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tgqg2_5a4f87bc-7b94-4e9e-a079-ea6cafe23138/manager/0.log" Jun 11 18:33:42.993586 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:42.993552 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2lhln_bacc96aa-2d09-4d93-ba22-d4fcf18d36cf/limitador/0.log" Jun 11 18:33:43.587280 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:43.587253 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-tc8vk_586add5b-cdc5-41bd-a75a-84699a96fe31/discovery/0.log" Jun 11 18:33:43.697376 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:43.697350 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff7f75b64-ch2dh_d4fae104-1f92-4ca4-82ae-2318e1c50fd2/kube-auth-proxy/0.log" Jun 11 18:33:44.608705 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.608667 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb_44427006-044e-4310-b07b-e7d392da6827/storage-initializer/0.log" Jun 11 18:33:44.615993 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.615968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cldkb_44427006-044e-4310-b07b-e7d392da6827/main/0.log" Jun 11 18:33:44.852844 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.852810 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp_4881a935-ab4e-4b1d-addc-b115899a2f85/storage-initializer/0.log" Jun 11 18:33:44.860699 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.860628 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-snzvp_4881a935-ab4e-4b1d-addc-b115899a2f85/main/0.log" Jun 11 18:33:44.978218 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.978196 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw_2214479a-03ec-4372-9036-21c597923746/storage-initializer/0.log" Jun 11 18:33:44.985626 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:44.985606 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgl9sw_2214479a-03ec-4372-9036-21c597923746/main/0.log" Jun 11 18:33:51.939438 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:51.939402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6t52c_ebc27922-4bdf-41bc-9c57-f03234d46b89/global-pull-secret-syncer/0.log" Jun 11 18:33:52.110039 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:52.110005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lqjcd_7e4fb0f4-66d7-44c1-960e-52d9f994435f/konnectivity-agent/0.log" Jun 11 18:33:52.181400 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:52.181368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-204.ec2.internal_df5acc5da7deed969d9d6b9c58d33ee0/haproxy/0.log" Jun 11 18:33:56.927432 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:56.927404 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/extract/0.log" Jun 11 18:33:56.957952 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:56.957916 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/util/0.log" Jun 11 18:33:56.977262 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:56.977237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c7l8m_c6a64f8d-04c8-42a8-9c43-bc6b625eaaf3/pull/0.log" Jun 11 18:33:57.001502 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.001476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/extract/0.log" Jun 11 18:33:57.027286 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.027261 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/util/0.log" Jun 11 18:33:57.047855 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.047835 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mjfr7_1357cefe-dd7e-4f85-9020-7dd141e0b5df/pull/0.log" Jun 11 18:33:57.071332 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.071310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/extract/0.log" Jun 11 18:33:57.090038 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.090018 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/util/0.log" Jun 11 18:33:57.107942 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.107920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j8r67_588a62d7-ba86-4d2f-861e-31fcd6b34de8/pull/0.log" Jun 11 18:33:57.135519 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.135498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/extract/0.log" Jun 11 18:33:57.153052 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.153026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/util/0.log" Jun 11 18:33:57.171966 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.171939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16qmjq_21670ca2-e4ff-45b9-89bc-6ec2540b6025/pull/0.log" Jun 11 18:33:57.657660 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.657631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tgqg2_5a4f87bc-7b94-4e9e-a079-ea6cafe23138/manager/0.log" Jun 11 18:33:57.828263 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:57.828233 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2lhln_bacc96aa-2d09-4d93-ba22-d4fcf18d36cf/limitador/0.log" Jun 11 18:33:59.350012 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.349982 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/alertmanager/0.log" Jun 11 18:33:59.376657 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.376635 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/config-reloader/0.log" Jun 11 18:33:59.395715 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.395683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/kube-rbac-proxy-web/0.log" Jun 11 18:33:59.414381 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.414363 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/kube-rbac-proxy/0.log" Jun 11 18:33:59.438859 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.438834 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/kube-rbac-proxy-metric/0.log" Jun 11 18:33:59.457257 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.457238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/prom-label-proxy/0.log" Jun 11 18:33:59.477477 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.477456 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_234ecb41-6917-4b4c-9efb-565178d59694/init-config-reloader/0.log" Jun 11 18:33:59.540026 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.540005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-r4mx9_4f516fb0-d89b-422f-9d45-56e0763e25cb/kube-state-metrics/0.log" Jun 11 18:33:59.558121 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.558099 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-r4mx9_4f516fb0-d89b-422f-9d45-56e0763e25cb/kube-rbac-proxy-main/0.log" Jun 11 18:33:59.596138 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.596112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-r4mx9_4f516fb0-d89b-422f-9d45-56e0763e25cb/kube-rbac-proxy-self/0.log" Jun 11 18:33:59.638192 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.638107 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54895d84b-z5khc_5d47c450-16c4-4fce-8b48-a09ffd632fc6/metrics-server/0.log" Jun 11 18:33:59.863331 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.863307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjxjk_ffd39343-cd1e-4f12-93f3-6269fb0c7190/node-exporter/0.log" Jun 11 18:33:59.901197 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.901109 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjxjk_ffd39343-cd1e-4f12-93f3-6269fb0c7190/kube-rbac-proxy/0.log" Jun 11 18:33:59.940969 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:33:59.940945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjxjk_ffd39343-cd1e-4f12-93f3-6269fb0c7190/init-textfile/0.log" Jun 11 18:34:00.544288 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.544255 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-wmpc9_ef7118fa-2721-44f7-8d1e-f759b3bb0fc6/prometheus-operator/0.log" Jun 11 18:34:00.575223 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.575195 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-wmpc9_ef7118fa-2721-44f7-8d1e-f759b3bb0fc6/kube-rbac-proxy/0.log" Jun 11 18:34:00.615226 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.615204 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-fmbgx_648a38c0-2ff6-49f8-9f6c-92f93c30321c/prometheus-operator-admission-webhook/0.log" Jun 11 18:34:00.658220 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.658147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8547b66d9c-2x7p5_02d59574-36cd-4167-bee7-00f378f49d96/telemeter-client/0.log" Jun 11 18:34:00.710035 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.710014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8547b66d9c-2x7p5_02d59574-36cd-4167-bee7-00f378f49d96/reload/0.log" Jun 11 18:34:00.747194 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.747150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8547b66d9c-2x7p5_02d59574-36cd-4167-bee7-00f378f49d96/kube-rbac-proxy/0.log" Jun 11 18:34:00.790427 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.790408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/thanos-query/0.log" Jun 11 18:34:00.830047 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.830021 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/kube-rbac-proxy-web/0.log" Jun 11 18:34:00.877060 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.877038 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/kube-rbac-proxy/0.log" Jun 11 18:34:00.913042 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.912980 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/prom-label-proxy/0.log" Jun 11 18:34:00.945081 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.945065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/kube-rbac-proxy-rules/0.log" Jun 11 18:34:00.985054 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:00.985023 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b8d5b7b-ctlg4_8e1689a6-7845-4167-8d8b-b1a5885f0d5b/kube-rbac-proxy-metrics/0.log" Jun 11 18:34:02.165751 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:02.165723 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-gj8qc_5bf0a3fa-218e-4379-aafc-169e54cfe303/networking-console-plugin/0.log" Jun 11 18:34:02.812550 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:02.812518 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/1.log" Jun 11 18:34:02.821352 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:02.821325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-m6w9m_2664630f-df16-4df1-9904-ff4a5ca3ead0/console-operator/2.log" Jun 11 18:34:03.387296 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.387264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-x9fv7_737a9b2c-5901-4fc7-b8b1-a1989a259bfb/download-server/0.log" Jun 11 18:34:03.521462 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.521426 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t"] Jun 11 18:34:03.521893 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.521880 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f792764-05d2-4497-b771-9c01881e68f9" containerName="cleanup" Jun 11 18:34:03.521946 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.521897 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f792764-05d2-4497-b771-9c01881e68f9" containerName="cleanup" Jun 11 18:34:03.521985 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.521961 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f792764-05d2-4497-b771-9c01881e68f9" containerName="cleanup" Jun 11 18:34:03.524902 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.524887 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.527413 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.527394 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-95tlw\"/\"openshift-service-ca.crt\"" Jun 11 18:34:03.527545 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.527529 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-95tlw\"/\"kube-root-ca.crt\"" Jun 11 18:34:03.528659 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.528645 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-95tlw\"/\"default-dockercfg-pw5wx\"" Jun 11 18:34:03.535615 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.535594 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t"] Jun 11 18:34:03.656681 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.656607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-podres\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.656681 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.656645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-proc\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.656850 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.656685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-sys\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.656850 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.656717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-lib-modules\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.656850 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.656763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whnx6\" (UniqueName: \"kubernetes.io/projected/546fbf53-8b9b-4f35-ac11-53092010c863-kube-api-access-whnx6\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757492 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whnx6\" (UniqueName: \"kubernetes.io/projected/546fbf53-8b9b-4f35-ac11-53092010c863-kube-api-access-whnx6\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-podres\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-proc\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-sys\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-lib-modules\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757837 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-sys\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757837 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-podres\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757837 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-proc\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.757837 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.757726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/546fbf53-8b9b-4f35-ac11-53092010c863-lib-modules\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.765777 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.765753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whnx6\" (UniqueName: \"kubernetes.io/projected/546fbf53-8b9b-4f35-ac11-53092010c863-kube-api-access-whnx6\") pod \"perf-node-gather-daemonset-bqs8t\" (UID: \"546fbf53-8b9b-4f35-ac11-53092010c863\") " pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.835560 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.835532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:03.975444 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:03.975414 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t"] Jun 11 18:34:03.976654 ip-10-0-133-204 kubenswrapper[2574]: W0611 18:34:03.976625 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod546fbf53_8b9b_4f35_ac11_53092010c863.slice/crio-2bd77315b37a5efd891285621ef987e7b840716da678710477a54ec582e63fd8 WatchSource:0}: Error finding container 2bd77315b37a5efd891285621ef987e7b840716da678710477a54ec582e63fd8: Status 404 returned error can't find the container with id 2bd77315b37a5efd891285621ef987e7b840716da678710477a54ec582e63fd8 Jun 11 18:34:04.861069 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:04.861025 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" event={"ID":"546fbf53-8b9b-4f35-ac11-53092010c863","Type":"ContainerStarted","Data":"ca8ba1fd5a7948ae4491ebde71e5c3fe18f732513fdcbd0bc0d6b6b8c982ec5f"} Jun 11 18:34:04.861460 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:04.861087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" event={"ID":"546fbf53-8b9b-4f35-ac11-53092010c863","Type":"ContainerStarted","Data":"2bd77315b37a5efd891285621ef987e7b840716da678710477a54ec582e63fd8"} Jun 11 18:34:04.861460 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:04.861214 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:04.877762 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:04.877719 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" podStartSLOduration=1.877704941 podStartE2EDuration="1.877704941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:34:04.87625892 +0000 UTC m=+2800.970352428" watchObservedRunningTime="2026-06-11 18:34:04.877704941 +0000 UTC m=+2800.971798426" Jun 11 18:34:05.097453 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:05.097424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92hvr_21f1ec37-dc61-44e8-aa58-b2552536b972/dns/0.log" Jun 11 18:34:05.116799 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:05.116729 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92hvr_21f1ec37-dc61-44e8-aa58-b2552536b972/kube-rbac-proxy/0.log" Jun 11 18:34:05.243820 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:05.243786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8p7p_99fa751d-c4b6-490b-aa65-cb8b85e02175/dns-node-resolver/0.log" Jun 11 18:34:05.827643 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:05.827610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rb8j9_d47c06f4-a40c-4ac8-8181-d58333183ad1/node-ca/0.log" Jun 11 18:34:06.849898 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:06.849843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-tc8vk_586add5b-cdc5-41bd-a75a-84699a96fe31/discovery/0.log" Jun 11 18:34:06.867033 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:06.867006 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff7f75b64-ch2dh_d4fae104-1f92-4ca4-82ae-2318e1c50fd2/kube-auth-proxy/0.log" Jun 11 18:34:07.700684 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:07.700648 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q528d_901a14ba-c704-48a1-8bb1-03444eda270e/serve-healthcheck-canary/0.log" Jun 11 18:34:08.294925 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:08.294890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cthtb_582534e8-13b3-4d5d-812e-eb3ebd52a66b/kube-rbac-proxy/0.log" Jun 11 18:34:08.312597 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:08.312569 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cthtb_582534e8-13b3-4d5d-812e-eb3ebd52a66b/exporter/0.log" Jun 11 18:34:08.331912 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:08.331892 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cthtb_582534e8-13b3-4d5d-812e-eb3ebd52a66b/extractor/0.log" Jun 11 18:34:10.501476 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.501447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7986cb5f7-lg9bv_5c1dc3fb-6eb1-4833-80aa-e85f5bc32636/nginx/0.log" Jun 11 18:34:10.555446 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.555425 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8gkfp_fb3cad0a-cf20-429f-befe-9af3b217eee1/manager/0.log" Jun 11 18:34:10.655103 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.655081 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gtn7k_0c08aa41-962b-4f0b-918d-297933470d4b/manager/0.log" Jun 11 18:34:10.783383 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.783298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686695-rxqc5_c77eb618-59cf-4548-b878-763e39b12d7a/cleanup/0.log" Jun 11 18:34:10.804597 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.804570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686710-gtc62_8f792764-05d2-4497-b771-9c01881e68f9/cleanup/0.log" Jun 11 18:34:10.877115 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.877088 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-95tlw/perf-node-gather-daemonset-bqs8t" Jun 11 18:34:10.952116 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:10.952094 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2bdph_6c307435-4e51-4b4a-b246-f963b7919167/server/0.log" Jun 11 18:34:11.028137 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:11.028112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-djh2s_b5a275e5-c68f-4f7d-97e8-87647961e03a/manager/0.log" Jun 11 18:34:11.308999 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:11.308970 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfd79d7d-lx7cd_1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5/manager/0.log" Jun 11 18:34:11.325502 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:11.325476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfd79d7d-lx7cd_1fbb84c5-cfd1-4656-8cbf-5b03e4fb42a5/copy-manifests/0.log" Jun 11 18:34:13.115928 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:13.115891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lkw7n_caa77139-b42a-4271-90d9-130c50fcea6a/openshift-lws-operator/0.log" Jun 11 18:34:16.787721 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:16.787693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-tc8vk_586add5b-cdc5-41bd-a75a-84699a96fe31/discovery/0.log" Jun 11 18:34:16.798294 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:16.798268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff7f75b64-ch2dh_d4fae104-1f92-4ca4-82ae-2318e1c50fd2/kube-auth-proxy/0.log" Jun 11 18:34:18.215993 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:18.215961 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-tc8vk_586add5b-cdc5-41bd-a75a-84699a96fe31/discovery/0.log" Jun 11 18:34:18.227390 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:18.227368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff7f75b64-ch2dh_d4fae104-1f92-4ca4-82ae-2318e1c50fd2/kube-auth-proxy/0.log" Jun 11 18:34:19.729610 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.729585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/kube-multus-additional-cni-plugins/0.log" Jun 11 18:34:19.747947 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.747920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/egress-router-binary-copy/0.log" Jun 11 18:34:19.764822 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.764799 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/cni-plugins/0.log" Jun 11 18:34:19.785107 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.785068 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/bond-cni-plugin/0.log" Jun 11 18:34:19.802904 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.802883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/routeoverride-cni/0.log" Jun 11 18:34:19.820512 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.820492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/whereabouts-cni-bincopy/0.log" Jun 11 18:34:19.841057 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:19.841037 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9lfcn_a6581553-8e92-48e5-9ad6-d80f6da12f7b/whereabouts-cni/0.log" Jun 11 18:34:20.190621 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:20.190588 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-tc8vk_586add5b-cdc5-41bd-a75a-84699a96fe31/discovery/0.log" Jun 11 18:34:20.201568 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:20.201540 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff7f75b64-ch2dh_d4fae104-1f92-4ca4-82ae-2318e1c50fd2/kube-auth-proxy/0.log" Jun 11 18:34:20.205186 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:20.205158 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mg76q_53c40270-3cc5-4ebd-aca2-e6e9de611350/kube-multus/0.log" Jun 11 18:34:20.231195 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:20.230659 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4v2rl_ee875c8a-b9c4-45e0-954d-bc0a5ae887b5/network-metrics-daemon/0.log" Jun 11 18:34:20.247059 ip-10-0-133-204 kubenswrapper[2574]: I0611 18:34:20.247036 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4v2rl_ee875c8a-b9c4-45e0-954d-bc0a5ae887b5/kube-rbac-proxy/0.log"