Jun 09 15:11:25.338863 ip-10-0-132-252 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 15:11:25.338875 ip-10-0-132-252 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 15:11:25.338886 ip-10-0-132-252 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 15:11:25.339214 ip-10-0-132-252 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 15:11:35.346223 ip-10-0-132-252 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 15:11:35.346241 ip-10-0-132-252 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 97c67fd8d1b7410cb7d831c766e76b98 -- Jun 09 15:14:05.062239 ip-10-0-132-252 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:14:05.504632 ip-10-0-132-252 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:05.504632 ip-10-0-132-252 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:14:05.504632 ip-10-0-132-252 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:05.504632 ip-10-0-132-252 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:14:05.504632 ip-10-0-132-252 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:05.506795 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.506687 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:14:05.514847 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514821 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.514847 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514842 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.514847 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514847 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.514847 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514850 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.514847 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514853 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514858 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514863 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514866 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514870 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514872 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514876 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514879 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514881 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514884 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514887 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514889 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514892 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514895 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514898 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514901 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514917 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514920 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514922 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.515072 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514925 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514928 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514931 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514933 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514936 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514939 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514942 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514944 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514947 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514949 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514952 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514954 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514957 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514959 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514962 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514965 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514968 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514970 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514974 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514976 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.515531 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514979 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514982 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514984 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514987 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514990 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514992 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514995 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.514997 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515000 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515003 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515005 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515008 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515010 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515013 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515015 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515018 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515020 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515023 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515026 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515028 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.516037 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515031 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515033 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515037 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515040 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515043 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515046 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515049 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515054 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515057 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515060 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515064 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515068 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515071 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515074 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515078 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515081 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515084 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515087 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515089 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.516507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515092 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515096 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515098 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515101 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515104 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515106 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515109 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515111 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515114 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515116 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515119 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515122 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515124 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515127 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515130 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515133 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515135 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515870 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515877 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515880 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.516971 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515884 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515887 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515890 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515892 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515896 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515899 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515914 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515917 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515919 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515922 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515925 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515927 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515930 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515933 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515936 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515939 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515942 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515944 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515949 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.517450 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515953 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515956 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515959 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515962 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515965 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515968 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515971 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515974 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515976 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515979 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515982 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515985 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515988 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515992 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515994 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.515997 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516000 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516003 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516006 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.517937 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516008 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516011 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516014 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516017 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516019 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516022 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516024 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516027 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516029 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516033 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516037 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516040 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516046 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516049 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516053 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516055 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516058 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516061 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516064 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.518498 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516067 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516070 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516073 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516076 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516078 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516081 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516084 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516087 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516089 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516092 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516095 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516098 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516100 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516103 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516105 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516108 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516111 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516113 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516116 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516118 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.518997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516120 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516123 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516125 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516128 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516132 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516134 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516137 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516140 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516142 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516144 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516147 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516149 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516152 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516154 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516157 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516159 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516162 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516165 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516167 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516554 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.519499 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516560 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516564 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516568 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516571 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516574 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516577 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516580 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516582 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516585 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516588 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516591 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516595 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516599 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516602 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516605 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516608 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516611 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516614 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516616 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.519996 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516619 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516622 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516624 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516627 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516631 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516633 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516635 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516638 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516641 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516644 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516646 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516649 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516651 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516654 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516656 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516659 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516662 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516664 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516667 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516669 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.520461 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516672 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516674 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516677 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516679 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516682 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516685 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516687 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516690 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516693 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516697 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516699 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516702 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516704 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516707 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516709 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516711 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516714 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516716 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516719 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516721 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.520997 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516724 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516727 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516729 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516732 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516734 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516737 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516740 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516742 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516744 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516747 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516749 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516752 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516756 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516758 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516761 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516763 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516765 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516768 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516770 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.521476 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516773 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516776 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516778 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516781 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516783 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516786 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516788 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516791 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516794 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516797 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516800 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516802 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516805 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516807 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516810 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516813 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516815 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516818 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516821 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.516823 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516900 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:14:05.521962 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516932 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516941 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516948 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516954 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516957 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516962 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516966 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516969 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516973 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516977 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516980 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516986 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516989 2566 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516992 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516995 2566 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.516999 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517002 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517007 2566 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517010 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517013 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517016 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517019 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517024 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:14:05.522500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517027 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517030 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517033 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517036 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517039 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517042 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517046 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517049 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517053 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517056 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517059 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517061 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517064 2566 flags.go:64] FLAG: --enable-server="true" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517067 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517071 2566 flags.go:64] FLAG: --event-burst="100" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517075 2566 flags.go:64] FLAG: --event-qps="50" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517078 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517081 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517084 2566 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517087 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517092 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517095 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517098 2566 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517100 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517103 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:14:05.523094 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517107 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517110 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517113 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517115 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517118 2566 flags.go:64] FLAG: --feature-gates="" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517122 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517128 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517131 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517134 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517137 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517140 2566 flags.go:64] FLAG: --help="false" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517143 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517147 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517150 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517153 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517156 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517159 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517162 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517165 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517168 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517171 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517174 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517177 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517180 2566 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:14:05.523715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517182 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517185 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517188 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517193 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517196 2566 flags.go:64] FLAG: --lock-file="" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517199 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517202 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517205 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517210 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517213 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517216 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517219 2566 flags.go:64] FLAG: --logging-format="text" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517222 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517226 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517230 2566 flags.go:64] FLAG: --manifest-url="" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517233 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517237 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517240 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517244 2566 flags.go:64] FLAG: --max-pods="110" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517247 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517251 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517253 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517256 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517259 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517262 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:14:05.524329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517265 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517272 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517275 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517278 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517281 2566 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517284 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517289 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517292 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517295 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517298 2566 flags.go:64] FLAG: --port="10250" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517302 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517305 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b1f2255f99db4703" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517309 2566 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517312 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517315 2566 flags.go:64] FLAG: --register-node="true" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517318 2566 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517321 2566 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517325 2566 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517328 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517331 2566 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517334 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517337 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517342 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517345 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517347 2566 flags.go:64] FLAG: --runonce="false" Jun 09 15:14:05.524957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517351 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517354 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517357 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517359 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517362 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517365 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517368 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517372 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517374 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517377 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517380 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517383 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517386 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517389 2566 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517392 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517397 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517399 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517404 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517408 2566 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517411 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517413 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517416 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517419 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517422 2566 flags.go:64] FLAG: --v="2" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517426 2566 flags.go:64] FLAG: --version="false" Jun 09 15:14:05.525566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517430 2566 flags.go:64] FLAG: --vmodule="" Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517434 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.517438 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517555 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517561 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517564 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517567 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517570 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517573 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517575 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517578 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517581 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517583 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517586 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517588 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517591 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517593 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517596 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517599 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.526176 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517602 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517604 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517606 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517609 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517613 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517618 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517621 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517625 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517628 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517630 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517633 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517636 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517639 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517642 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517645 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517648 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517651 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517655 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517657 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.526642 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517660 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517663 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517665 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517668 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517670 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517673 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517675 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517678 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517680 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517682 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517685 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517688 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517690 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517693 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517695 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517698 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517701 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517703 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517707 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517709 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.527140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517712 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517715 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517717 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517720 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517722 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517725 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517728 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517730 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517733 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517736 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517740 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517743 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517745 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517748 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517751 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517755 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517758 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517761 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517765 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.527635 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517769 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517771 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517774 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517777 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517779 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517782 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517784 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517787 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517789 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517792 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517795 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517798 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517801 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517804 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517806 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517809 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517812 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517815 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517817 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517820 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.528101 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517822 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517825 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517828 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517832 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.517835 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.518625 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.525873 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.525889 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.526848 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.526855 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526927 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526933 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526936 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526940 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526943 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.528581 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526946 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526948 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526951 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526954 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526958 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526960 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526963 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526965 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526968 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526971 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526974 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526976 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526979 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526982 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526984 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526987 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526989 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526992 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526994 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.528967 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526997 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.526999 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527002 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527005 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527008 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527012 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527015 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527018 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527020 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527023 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527026 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527028 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527031 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527033 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527037 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527041 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527044 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527047 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527050 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.529451 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527053 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527056 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527059 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527062 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527065 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527068 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527070 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527073 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527076 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527078 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527081 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527084 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527088 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527091 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527094 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527097 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527100 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527103 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527107 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.529926 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527112 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527115 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527118 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527121 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527123 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527126 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527129 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527131 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527134 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527137 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527139 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527143 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527145 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527148 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527151 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527154 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527156 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527159 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527162 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527164 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.530376 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527167 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527170 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527173 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527175 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527178 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527180 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527183 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527186 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527188 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527191 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527194 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527197 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527200 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527203 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527206 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527209 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.530918 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527211 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.527216 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527333 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527338 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527341 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527344 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527347 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527350 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527353 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527356 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527358 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527361 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527364 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527367 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527370 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:05.531315 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527373 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527375 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527378 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527381 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527384 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527386 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527389 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527391 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527394 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527397 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527399 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527402 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527405 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527408 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527411 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527414 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527418 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527422 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527424 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527427 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:05.531678 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527430 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527433 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527435 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527438 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527441 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527444 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527447 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527450 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527452 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527456 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527460 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527464 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527467 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527470 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527473 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527476 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527478 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527481 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527484 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:05.532207 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527486 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527489 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527492 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527494 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527497 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527500 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527503 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527505 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527508 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527511 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527514 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527516 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527519 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527521 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527524 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527526 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527529 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527532 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527534 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527537 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:05.532661 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527539 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527542 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527544 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527547 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527549 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527552 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527555 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527557 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527560 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527563 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527565 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527568 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527570 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527573 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527575 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527578 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527581 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527583 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527586 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527589 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:05.533154 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527591 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527593 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527596 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527599 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527601 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527604 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:05.527606 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.527611 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.527732 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.530066 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.531782 2566 server.go:1019] "Starting client certificate rotation" Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.531878 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:05.533632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.531922 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:05.534877 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.534863 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:05.538961 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.538935 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:05.551391 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.551369 2566 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:14:05.554741 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.554714 2566 log.go:25] "Validated CRI v1 image API" Jun 09 15:14:05.556355 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.556340 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:14:05.559971 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.559945 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8f9f3767-a5b8-4e78-aa02-1e873f09375a:/dev/nvme0n1p4 df422740-e72b-40b1-8864-1a14de07dd06:/dev/nvme0n1p3] Jun 09 15:14:05.560045 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.559966 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:14:05.563363 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.563342 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:05.566213 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.566098 2566 manager.go:216] Machine: {Timestamp:2026-06-09 15:14:05.56459217 +0000 UTC m=+0.372351088 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098831 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbe821b431443bef0a813352c7bc7 SystemUUID:ec2bbe82-1b43-1443-bef0-a813352c7bc7 BootID:97c67fd8-d1b7-410c-b7d8-31c766e76b98 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:bc:09:1e:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:bc:09:1e:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:aa:c8:95:ff:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:14:05.566213 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.566206 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:14:05.566349 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.566295 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:14:05.569669 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.569645 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:14:05.569817 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.569671 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-252.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:14:05.570579 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.570569 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:14:05.570619 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.570582 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:14:05.570619 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.570590 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:05.571426 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.571405 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:05.572642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.572631 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:14:05.576994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.576981 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:05.577291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577281 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:14:05.577327 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577315 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:14:05.577357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577348 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:14:05.577385 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577359 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:14:05.577385 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577373 2566 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:14:05.577441 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577385 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:14:05.577791 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577778 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:05.577838 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.577797 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:05.580286 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.580269 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:14:05.582025 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582012 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:14:05.582069 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582041 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:14:05.582889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582865 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:14:05.582889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582886 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582938 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582948 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582974 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582986 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.582999 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.583011 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.583027 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:14:05.583050 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.583037 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:14:05.583295 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.583066 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:14:05.583295 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.583075 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:14:05.584016 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.584004 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:14:05.584067 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.584018 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:14:05.588284 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.588265 2566 server.go:1268] "Started kubelet" Jun 09 15:14:05.588356 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.588315 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:14:05.588821 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.588601 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:14:05.588883 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.588843 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:14:05.589098 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.589058 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-252.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:14:05.589193 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.589164 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:14:05.589193 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.589167 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:14:05.589349 ip-10-0-132-252 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:14:05.591019 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.591000 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:14:05.594287 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.594271 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:14:05.596267 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.596248 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:14:05.598068 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.596961 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-252.ec2.internal.18b77279e9d7e349 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-252.ec2.internal,UID:ip-10-0-132-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-252.ec2.internal,},FirstTimestamp:2026-06-09 15:14:05.588169545 +0000 UTC m=+0.395928444,LastTimestamp:2026-06-09 15:14:05.588169545 +0000 UTC m=+0.395928444,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-252.ec2.internal,}" Jun 09 15:14:05.601456 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.601436 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:14:05.601543 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.601526 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:05.601613 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.601593 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:05.602233 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602215 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:14:05.602233 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602216 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:14:05.602366 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602243 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:14:05.602416 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602366 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:14:05.602416 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602375 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:14:05.602591 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602564 2566 factory.go:55] Registering systemd factory Jun 09 15:14:05.602695 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602612 2566 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:14:05.602939 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602923 2566 factory.go:153] Registering CRI-O factory Jun 09 15:14:05.603002 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.602943 2566 factory.go:223] Registration of the crio container factory successfully Jun 09 15:14:05.603053 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.603016 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:14:05.603105 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.603056 2566 factory.go:103] Registering Raw factory Jun 09 15:14:05.603105 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.603077 2566 manager.go:1196] Started watching for new ooms in manager Jun 09 15:14:05.604275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.604256 2566 manager.go:349] Starting recovery of all containers Jun 09 15:14:05.606603 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.606577 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnwkp" Jun 09 15:14:05.613525 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.613347 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 15:14:05.613618 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.613449 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 15:14:05.614207 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.614189 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnwkp" Jun 09 15:14:05.614885 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.614871 2566 manager.go:354] Recovery completed Jun 09 15:14:05.620486 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.620470 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.622419 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622397 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.622486 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622430 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.622486 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622447 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.622967 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622951 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:14:05.622967 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622965 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:14:05.623110 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.622983 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:05.623110 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.623015 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.623678 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.623662 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.623748 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.623689 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.623748 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.623700 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.624889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.624875 2566 policy_none.go:49] "None policy: Start" Jun 09 15:14:05.624968 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.624892 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:14:05.624968 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.624916 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:14:05.626541 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.626530 2566 policy_none.go:47] "Start" Jun 09 15:14:05.656507 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656488 2566 manager.go:337] "Starting Device Plugin manager" Jun 09 15:14:05.656612 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.656531 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:14:05.656612 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656544 2566 server.go:87] "Starting device plugin registration server" Jun 09 15:14:05.656814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656801 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:14:05.656868 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656816 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:14:05.656938 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656885 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:14:05.657009 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.656994 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:14:05.657054 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.657011 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:14:05.657546 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.657526 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:14:05.657639 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.657581 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:05.678812 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.678776 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:14:05.686329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.680118 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:14:05.686329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.680152 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:14:05.686329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.680198 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:14:05.686329 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.680231 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:14:05.686329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.681988 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:05.757265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.757165 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.758415 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.758398 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.758476 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.758430 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.758476 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.758441 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.758476 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.758467 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.767568 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.767548 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.767627 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.767572 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-252.ec2.internal\": node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:05.781073 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.781039 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal"] Jun 09 15:14:05.781158 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.781115 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.782858 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.782843 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.782931 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.782870 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.782931 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.782879 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.785562 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.785549 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.785663 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.785649 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.785709 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.785680 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.786314 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786300 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.786382 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786326 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.786382 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786341 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.786382 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786358 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.786518 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786384 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.786518 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.786398 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.788737 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.788722 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:05.788812 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.788782 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.788812 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.788805 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:05.789496 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.789477 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:05.789577 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.789507 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:05.789577 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.789523 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:05.803270 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.803248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.803361 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.803279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.803361 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.803304 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfb6445305ea38939422cb2d303894d8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-252.ec2.internal\" (UID: \"dfb6445305ea38939422cb2d303894d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.813550 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.813528 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-252.ec2.internal\" not found" node="ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.818242 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.818202 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-252.ec2.internal\" not found" node="ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.889542 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.889498 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:05.903843 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.903843 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.904019 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfb6445305ea38939422cb2d303894d8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-252.ec2.internal\" (UID: \"dfb6445305ea38939422cb2d303894d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.904019 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfb6445305ea38939422cb2d303894d8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-252.ec2.internal\" (UID: \"dfb6445305ea38939422cb2d303894d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.904019 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.904019 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:05.903934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bb22ede631809705c4509fe15abe13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal\" (UID: \"3bb22ede631809705c4509fe15abe13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:05.990006 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:05.989962 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.090821 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.090761 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.121354 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.121314 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:06.126371 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.126354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:06.191732 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.191689 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.292316 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.292280 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.392822 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.392791 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.493395 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.493360 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.501243 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.501220 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:06.531132 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.531105 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:14:06.531746 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.531575 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:06.533108 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.531234 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:06.594162 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.594129 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.617843 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.617790 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 15:09:05 +0000 UTC" deadline="2028-02-04 16:54:58.401095718 +0000 UTC" Jun 09 15:14:06.617843 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.617834 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14521h40m51.783263941s" Jun 09 15:14:06.694483 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.694414 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.770128 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:06.770087 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb6445305ea38939422cb2d303894d8.slice/crio-228d2b43452a9ec5ab9af3aaf2810e949a4b2dc4c34731fa8106d3a49173311b WatchSource:0}: Error finding container 228d2b43452a9ec5ab9af3aaf2810e949a4b2dc4c34731fa8106d3a49173311b: Status 404 returned error can't find the container with id 228d2b43452a9ec5ab9af3aaf2810e949a4b2dc4c34731fa8106d3a49173311b Jun 09 15:14:06.770723 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:06.770696 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb22ede631809705c4509fe15abe13f.slice/crio-4eeeea5323bad34cbae09f8f005c763a3a88d5a51edccb7363dbe30cdd2ba7da WatchSource:0}: Error finding container 4eeeea5323bad34cbae09f8f005c763a3a88d5a51edccb7363dbe30cdd2ba7da: Status 404 returned error can't find the container with id 4eeeea5323bad34cbae09f8f005c763a3a88d5a51edccb7363dbe30cdd2ba7da Jun 09 15:14:06.775074 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.775054 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:14:06.795325 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.795295 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.895798 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:06.895762 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-252.ec2.internal\" not found" Jun 09 15:14:06.928479 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.928449 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:06.989046 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:06.988957 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:07.002121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.002092 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" Jun 09 15:14:07.015623 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.015596 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:07.016787 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.016772 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" Jun 09 15:14:07.025127 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.025102 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:07.577844 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.577813 2566 apiserver.go:52] "Watching apiserver" Jun 09 15:14:07.585784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.585758 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:14:07.586429 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.586185 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r2lgj","kube-system/konnectivity-agent-9wtck","kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal","openshift-multus/multus-sc9j7","openshift-network-operator/iptables-alerter-zvx27","openshift-cluster-node-tuning-operator/tuned-k95xk","openshift-dns/node-resolver-zbmdc","openshift-image-registry/node-ca-bl6s7","openshift-multus/multus-additional-cni-plugins-c9cjv","openshift-multus/network-metrics-daemon-vdllv","openshift-network-diagnostics/network-check-target-z6kfd","openshift-ovn-kubernetes/ovnkube-node-tpxjc"] Jun 09 15:14:07.589149 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.588883 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.591266 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.591234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.592213 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.591997 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.592213 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.592021 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.592213 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.592063 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8vzb4\"" Jun 09 15:14:07.593793 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.593492 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.595160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.595142 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:14:07.595595 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.595575 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btlcm\"" Jun 09 15:14:07.595688 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.595662 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.595749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.595685 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:14:07.596399 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596577 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596586 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596711 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596938 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596950 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.597106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.596941 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5wwwr\"" Jun 09 15:14:07.599551 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.597948 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:07.599551 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.598076 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:07.599551 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.598526 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:14:07.599551 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.598778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.599955 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.599605 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gszz\"" Jun 09 15:14:07.600669 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.600308 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.602318 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.602221 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:07.602784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.602716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.605052 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605033 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:14:07.605367 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605349 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:14:07.605450 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605371 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:14:07.605450 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605388 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.605450 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605393 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.605588 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6nb5\"" Jun 09 15:14:07.605795 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.605777 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.608307 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.608289 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:14:07.608676 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.608461 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.608676 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.608467 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vlm9p\"" Jun 09 15:14:07.608676 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.608559 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.608955 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.608938 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.609031 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.609008 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:07.611218 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.611194 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.613618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.613603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.613739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.613720 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.614302 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-device-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.614302 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-system-cni-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614302 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.613649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614306 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-modprobe-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60e01511-a4ea-47cd-868e-e3776e149c9c-agent-certs\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-sys-fs\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.614485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmn9t\" (UniqueName: \"kubernetes.io/projected/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kube-api-access-mmn9t\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-os-release\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-slash\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4bx\" (UniqueName: \"kubernetes.io/projected/4dd834e1-653d-4b9f-8dbd-44d275786efd-kube-api-access-wc4bx\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-cnibin\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysconfig\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-kubernetes\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.614864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614847 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-kubelet\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-netns\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614927 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-etc-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-bin\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovn-node-metrics-cert\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.614998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-etc-selinux\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-lib-modules\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60e01511-a4ea-47cd-868e-e3776e149c9c-konnectivity-ca\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615067 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcft2\"" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-ovn\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-node-log\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-log-socket\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-env-overrides\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-registration-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-conf\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-host\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-tuned\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.615522 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbvx5\" (UniqueName: \"kubernetes.io/projected/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-kube-api-access-jbvx5\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-var-lib-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-netd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-socket-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8kp\" (UniqueName: \"kubernetes.io/projected/3758d68b-e5a7-4590-b678-a68239ccef32-kube-api-access-cg8kp\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-run\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-sys\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-var-lib-kubelet\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-tmp\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-systemd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-script-lib\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-systemd\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-systemd-units\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615867 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:14:07.616324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.615895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-config\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.617006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.616151 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:14:07.617006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.616165 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:14:07.617006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.616152 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b9cb6\"" Jun 09 15:14:07.617006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.616285 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.618784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.618767 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wh5nc\"" Jun 09 15:14:07.618953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.618933 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:14:07.619056 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.619039 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.619136 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.619110 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:07.634595 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.634571 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gcsh5" Jun 09 15:14:07.642256 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.642237 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gcsh5" Jun 09 15:14:07.686052 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.685990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" event={"ID":"3bb22ede631809705c4509fe15abe13f","Type":"ContainerStarted","Data":"4eeeea5323bad34cbae09f8f005c763a3a88d5a51edccb7363dbe30cdd2ba7da"} Jun 09 15:14:07.687293 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.687265 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" event={"ID":"dfb6445305ea38939422cb2d303894d8","Type":"ContainerStarted","Data":"228d2b43452a9ec5ab9af3aaf2810e949a4b2dc4c34731fa8106d3a49173311b"} Jun 09 15:14:07.703886 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.703851 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:14:07.716216 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-sys-fs\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-multus-certs\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4889488a-3f1c-49a3-8ca4-8fe439dbb535-hosts-file\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4889488a-3f1c-49a3-8ca4-8fe439dbb535-tmp-dir\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716311 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-slash\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-sys-fs\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-slash\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-kubelet\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-kubelet\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-bin\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovn-node-metrics-cert\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-bin\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-etc-selinux\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-socket-dir-parent\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-node-log\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-log-socket\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-tuned\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-node-log\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-system-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-log-socket\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.716953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssrj\" (UniqueName: \"kubernetes.io/projected/422044bf-f7f5-4813-8c67-6f7c273176d8-kube-api-access-kssrj\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-etc-selinux\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901527d2-6ef7-40fd-bfba-775e391d5493-host-slash\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-bin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-run\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716894 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-sys\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-script-lib\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716885 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716962 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-sys\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-run\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.716984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-dbus\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-systemd\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717036 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-config\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.717638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kubelet-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-device-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717082 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60e01511-a4ea-47cd-868e-e3776e149c9c-agent-certs\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-device-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-systemd\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmn9t\" (UniqueName: \"kubernetes.io/projected/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kube-api-access-mmn9t\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-os-release\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf2d5220-8d65-417c-9bbd-e40c1507718e-host\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-cnibin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4bx\" (UniqueName: \"kubernetes.io/projected/4dd834e1-653d-4b9f-8dbd-44d275786efd-kube-api-access-wc4bx\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-cnibin\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhpz\" (UniqueName: \"kubernetes.io/projected/cf2d5220-8d65-417c-9bbd-e40c1507718e-kube-api-access-9jhpz\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-os-release\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-script-lib\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.718357 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-netns\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-multus\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-hostroot\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-kubelet-config\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovnkube-config\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysconfig\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysconfig\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-kubernetes\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-netns\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-os-release\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-etc-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717835 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-etc-kubernetes\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-kubernetes\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6c7x\" (UniqueName: \"kubernetes.io/projected/99f90c41-2169-4223-839f-c576cc1a5b03-kube-api-access-h6c7x\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgtx\" (UniqueName: \"kubernetes.io/projected/4889488a-3f1c-49a3-8ca4-8fe439dbb535-kube-api-access-4zgtx\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717926 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-lib-modules\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60e01511-a4ea-47cd-868e-e3776e149c9c-konnectivity-ca\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-ovn\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-env-overrides\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718003 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-cnibin\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-registration-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-conf\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.717617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-host\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbvx5\" (UniqueName: \"kubernetes.io/projected/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-kube-api-access-jbvx5\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-run-netns\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-var-lib-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-etc-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-netd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-kubelet\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-socket-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-var-lib-kubelet\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.719985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-tmp\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-systemd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-registration-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-systemd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-system-cni-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-k8s-cni-cncf-io\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-lib-modules\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-conf-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd834e1-653d-4b9f-8dbd-44d275786efd-env-overrides\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901527d2-6ef7-40fd-bfba-775e391d5493-iptables-alerter-script\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718601 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-conf\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718602 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-socket-dir\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3758d68b-e5a7-4590-b678-a68239ccef32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-run-ovn\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-var-lib-kubelet\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3758d68b-e5a7-4590-b678-a68239ccef32-system-cni-dir\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.720650 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-var-lib-openvswitch\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-host\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718761 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-sysctl-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60e01511-a4ea-47cd-868e-e3776e149c9c-konnectivity-ca\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.718920 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-host-cni-netd\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-systemd-units\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8kp\" (UniqueName: \"kubernetes.io/projected/3758d68b-e5a7-4590-b678-a68239ccef32-kube-api-access-cg8kp\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf2d5220-8d65-417c-9bbd-e40c1507718e-serviceca\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-cni-binary-copy\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd834e1-653d-4b9f-8dbd-44d275786efd-systemd-units\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-daemon-config\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5ln\" (UniqueName: \"kubernetes.io/projected/901527d2-6ef7-40fd-bfba-775e391d5493-kube-api-access-ft5ln\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-modprobe-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.719327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-modprobe-d\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.720634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-etc-tuned\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.721153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.720646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd834e1-653d-4b9f-8dbd-44d275786efd-ovn-node-metrics-cert\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.721620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.720698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60e01511-a4ea-47cd-868e-e3776e149c9c-agent-certs\") pod \"konnectivity-agent-9wtck\" (UID: \"60e01511-a4ea-47cd-868e-e3776e149c9c\") " pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.721620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.720815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-tmp\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.726701 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.726679 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:07.726701 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.726700 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:07.726701 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.726722 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:07.726991 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.726797 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:08.226780028 +0000 UTC m=+3.034538936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:07.728150 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.728113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4bx\" (UniqueName: \"kubernetes.io/projected/4dd834e1-653d-4b9f-8dbd-44d275786efd-kube-api-access-wc4bx\") pod \"ovnkube-node-tpxjc\" (UID: \"4dd834e1-653d-4b9f-8dbd-44d275786efd\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.728376 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.728357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8kp\" (UniqueName: \"kubernetes.io/projected/3758d68b-e5a7-4590-b678-a68239ccef32-kube-api-access-cg8kp\") pod \"multus-additional-cni-plugins-c9cjv\" (UID: \"3758d68b-e5a7-4590-b678-a68239ccef32\") " pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.728494 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.728479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmn9t\" (UniqueName: \"kubernetes.io/projected/8ab0b5de-9b44-4d32-bf3b-8a1d20c81305-kube-api-access-mmn9t\") pod \"aws-ebs-csi-driver-node-blsrx\" (UID: \"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.728831 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.728811 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbvx5\" (UniqueName: \"kubernetes.io/projected/efcad9ff-12c0-4307-b0d7-d23c05a0ed6d-kube-api-access-jbvx5\") pod \"tuned-k95xk\" (UID: \"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d\") " pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.820532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-system-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssrj\" (UniqueName: \"kubernetes.io/projected/422044bf-f7f5-4813-8c67-6f7c273176d8-kube-api-access-kssrj\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901527d2-6ef7-40fd-bfba-775e391d5493-host-slash\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-bin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-system-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820648 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901527d2-6ef7-40fd-bfba-775e391d5493-host-slash\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-cni-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-dbus\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf2d5220-8d65-417c-9bbd-e40c1507718e-host\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-cnibin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-bin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhpz\" (UniqueName: \"kubernetes.io/projected/cf2d5220-8d65-417c-9bbd-e40c1507718e-kube-api-access-9jhpz\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.820767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf2d5220-8d65-417c-9bbd-e40c1507718e-host\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-dbus\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.820818 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-os-release\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-cnibin\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-os-release\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-netns\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-multus\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-netns\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.820972 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:08.320947584 +0000 UTC m=+3.128706489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.820975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-cni-multus\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-hostroot\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-kubelet-config\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-etc-kubernetes\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-hostroot\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6c7x\" (UniqueName: \"kubernetes.io/projected/99f90c41-2169-4223-839f-c576cc1a5b03-kube-api-access-h6c7x\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-etc-kubernetes\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-kubelet-config\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.821337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgtx\" (UniqueName: \"kubernetes.io/projected/4889488a-3f1c-49a3-8ca4-8fe439dbb535-kube-api-access-4zgtx\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-kubelet\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-k8s-cni-cncf-io\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-conf-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901527d2-6ef7-40fd-bfba-775e391d5493-iptables-alerter-script\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf2d5220-8d65-417c-9bbd-e40c1507718e-serviceca\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-cni-binary-copy\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-daemon-config\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821303 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-conf-dir\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ln\" (UniqueName: \"kubernetes.io/projected/901527d2-6ef7-40fd-bfba-775e391d5493-kube-api-access-ft5ln\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-multus-certs\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4889488a-3f1c-49a3-8ca4-8fe439dbb535-hosts-file\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4889488a-3f1c-49a3-8ca4-8fe439dbb535-tmp-dir\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-socket-dir-parent\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821458 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-var-lib-kubelet\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-k8s-cni-cncf-io\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.821534 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:07.822136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-socket-dir-parent\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:07.821608 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:08.321592028 +0000 UTC m=+3.129350930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4889488a-3f1c-49a3-8ca4-8fe439dbb535-hosts-file\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf2d5220-8d65-417c-9bbd-e40c1507718e-serviceca\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/422044bf-f7f5-4813-8c67-6f7c273176d8-host-run-multus-certs\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821928 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-cni-binary-copy\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.821936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901527d2-6ef7-40fd-bfba-775e391d5493-iptables-alerter-script\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.822057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/422044bf-f7f5-4813-8c67-6f7c273176d8-multus-daemon-config\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.822693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.822103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4889488a-3f1c-49a3-8ca4-8fe439dbb535-tmp-dir\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.830774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.830710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssrj\" (UniqueName: \"kubernetes.io/projected/422044bf-f7f5-4813-8c67-6f7c273176d8-kube-api-access-kssrj\") pod \"multus-sc9j7\" (UID: \"422044bf-f7f5-4813-8c67-6f7c273176d8\") " pod="openshift-multus/multus-sc9j7" Jun 09 15:14:07.830774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.830720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgtx\" (UniqueName: \"kubernetes.io/projected/4889488a-3f1c-49a3-8ca4-8fe439dbb535-kube-api-access-4zgtx\") pod \"node-resolver-zbmdc\" (UID: \"4889488a-3f1c-49a3-8ca4-8fe439dbb535\") " pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.830988 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.830963 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5ln\" (UniqueName: \"kubernetes.io/projected/901527d2-6ef7-40fd-bfba-775e391d5493-kube-api-access-ft5ln\") pod \"iptables-alerter-zvx27\" (UID: \"901527d2-6ef7-40fd-bfba-775e391d5493\") " pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.831053 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.831013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhpz\" (UniqueName: \"kubernetes.io/projected/cf2d5220-8d65-417c-9bbd-e40c1507718e-kube-api-access-9jhpz\") pod \"node-ca-bl6s7\" (UID: \"cf2d5220-8d65-417c-9bbd-e40c1507718e\") " pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.831436 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.831416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6c7x\" (UniqueName: \"kubernetes.io/projected/99f90c41-2169-4223-839f-c576cc1a5b03-kube-api-access-h6c7x\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:07.904753 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.904725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k95xk" Jun 09 15:14:07.912073 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.912050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:07.916045 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:07.916013 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcad9ff_12c0_4307_b0d7_d23c05a0ed6d.slice/crio-51a9cca9f4bee1cb26b6200c268f596498ba68d7f01f447b8907e268a98a8849 WatchSource:0}: Error finding container 51a9cca9f4bee1cb26b6200c268f596498ba68d7f01f447b8907e268a98a8849: Status 404 returned error can't find the container with id 51a9cca9f4bee1cb26b6200c268f596498ba68d7f01f447b8907e268a98a8849 Jun 09 15:14:07.921075 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.921058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:07.921369 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:07.921347 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd834e1_653d_4b9f_8dbd_44d275786efd.slice/crio-806133a9f5a0e6a2b5f09b5dd008be52eaccfa133f063e8675c1cb8f54082c7c WatchSource:0}: Error finding container 806133a9f5a0e6a2b5f09b5dd008be52eaccfa133f063e8675c1cb8f54082c7c: Status 404 returned error can't find the container with id 806133a9f5a0e6a2b5f09b5dd008be52eaccfa133f063e8675c1cb8f54082c7c Jun 09 15:14:07.925779 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.925760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" Jun 09 15:14:07.932181 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:07.932146 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e01511_a4ea_47cd_868e_e3776e149c9c.slice/crio-5e08805db9996c19372db4b994b3918e50227f552f5ebed7baf7e3c5f2fd5fd5 WatchSource:0}: Error finding container 5e08805db9996c19372db4b994b3918e50227f552f5ebed7baf7e3c5f2fd5fd5: Status 404 returned error can't find the container with id 5e08805db9996c19372db4b994b3918e50227f552f5ebed7baf7e3c5f2fd5fd5 Jun 09 15:14:07.932321 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.932197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" Jun 09 15:14:07.935877 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:07.935850 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab0b5de_9b44_4d32_bf3b_8a1d20c81305.slice/crio-43050fab63861de8c8b4ff8220786270cc81c50092f4cc9d70ea8e67b453c04a WatchSource:0}: Error finding container 43050fab63861de8c8b4ff8220786270cc81c50092f4cc9d70ea8e67b453c04a: Status 404 returned error can't find the container with id 43050fab63861de8c8b4ff8220786270cc81c50092f4cc9d70ea8e67b453c04a Jun 09 15:14:07.941251 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.941222 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zvx27" Jun 09 15:14:07.943020 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:07.942995 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3758d68b_e5a7_4590_b678_a68239ccef32.slice/crio-bab83d2ddb61e4a53ba36256612057d36095e927b8dec69844cba5fe2271236d WatchSource:0}: Error finding container bab83d2ddb61e4a53ba36256612057d36095e927b8dec69844cba5fe2271236d: Status 404 returned error can't find the container with id bab83d2ddb61e4a53ba36256612057d36095e927b8dec69844cba5fe2271236d Jun 09 15:14:07.949282 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.949263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zbmdc" Jun 09 15:14:07.956324 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.956302 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bl6s7" Jun 09 15:14:07.965225 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:07.965202 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc9j7" Jun 09 15:14:08.076224 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.076191 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:08.325532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.325502 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:08.325739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.325552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:08.325739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.325596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:08.325739 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325642 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:08.325739 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325710 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:08.325739 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325726 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:08.326023 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325731 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:08.326023 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325785 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:08.326023 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:09.325694158 +0000 UTC m=+4.133453043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:08.326023 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325824 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:09.32581175 +0000 UTC m=+4.133570635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:08.326023 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.325840 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:09.325830245 +0000 UTC m=+4.133589131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:08.646751 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.646689 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:07 +0000 UTC" deadline="2027-12-17 16:44:29.312991652 +0000 UTC" Jun 09 15:14:08.646751 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.646746 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13345h30m20.666248785s" Jun 09 15:14:08.681163 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.681129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:08.681382 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:08.681279 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:08.690534 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.690492 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"806133a9f5a0e6a2b5f09b5dd008be52eaccfa133f063e8675c1cb8f54082c7c"} Jun 09 15:14:08.692592 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.692527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k95xk" event={"ID":"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d","Type":"ContainerStarted","Data":"51a9cca9f4bee1cb26b6200c268f596498ba68d7f01f447b8907e268a98a8849"} Jun 09 15:14:08.693804 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.693778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerStarted","Data":"bab83d2ddb61e4a53ba36256612057d36095e927b8dec69844cba5fe2271236d"} Jun 09 15:14:08.695179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.695154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" event={"ID":"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305","Type":"ContainerStarted","Data":"43050fab63861de8c8b4ff8220786270cc81c50092f4cc9d70ea8e67b453c04a"} Jun 09 15:14:08.696837 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:08.696813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wtck" event={"ID":"60e01511-a4ea-47cd-868e-e3776e149c9c","Type":"ContainerStarted","Data":"5e08805db9996c19372db4b994b3918e50227f552f5ebed7baf7e3c5f2fd5fd5"} Jun 09 15:14:09.125140 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:09.125106 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4889488a_3f1c_49a3_8ca4_8fe439dbb535.slice/crio-d1fb650b5765e051eb2ed1c5c3bb47997c72540e928e12f86ac879b7f9093ad7 WatchSource:0}: Error finding container d1fb650b5765e051eb2ed1c5c3bb47997c72540e928e12f86ac879b7f9093ad7: Status 404 returned error can't find the container with id d1fb650b5765e051eb2ed1c5c3bb47997c72540e928e12f86ac879b7f9093ad7 Jun 09 15:14:09.131088 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:09.130774 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2d5220_8d65_417c_9bbd_e40c1507718e.slice/crio-21ce2efa4989dd164236421fa11e321a4382669ed4d7614649c55a6c542ebbf8 WatchSource:0}: Error finding container 21ce2efa4989dd164236421fa11e321a4382669ed4d7614649c55a6c542ebbf8: Status 404 returned error can't find the container with id 21ce2efa4989dd164236421fa11e321a4382669ed4d7614649c55a6c542ebbf8 Jun 09 15:14:09.334261 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.333681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:09.334261 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.334008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:09.334261 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.334053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334272 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334290 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334316 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334329 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334346 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:11.334325922 +0000 UTC m=+6.142084813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334407 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:11.334377784 +0000 UTC m=+6.142136688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334478 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:09.334518 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.334514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:11.334502715 +0000 UTC m=+6.142261602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:09.412378 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.412258 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:09.647830 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.647745 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:07 +0000 UTC" deadline="2028-02-21 10:41:37.414994994 +0000 UTC" Jun 09 15:14:09.647830 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.647800 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14923h27m27.767199612s" Jun 09 15:14:09.681121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.680940 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:09.681235 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.681190 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:09.681777 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.681636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:09.681777 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:09.681738 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:09.709072 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.709001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zbmdc" event={"ID":"4889488a-3f1c-49a3-8ca4-8fe439dbb535","Type":"ContainerStarted","Data":"d1fb650b5765e051eb2ed1c5c3bb47997c72540e928e12f86ac879b7f9093ad7"} Jun 09 15:14:09.720148 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.720066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc9j7" event={"ID":"422044bf-f7f5-4813-8c67-6f7c273176d8","Type":"ContainerStarted","Data":"b60dc0bbc1c2e01d4526446c0a23e61f44313be58b8eb508ac482aa881def8b3"} Jun 09 15:14:09.737118 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.737084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zvx27" event={"ID":"901527d2-6ef7-40fd-bfba-775e391d5493","Type":"ContainerStarted","Data":"87589815d2086cc19dc8c5a9585d432cd3b2ab5be823d1d6ea4d84763c1347ee"} Jun 09 15:14:09.761031 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.760997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bl6s7" event={"ID":"cf2d5220-8d65-417c-9bbd-e40c1507718e","Type":"ContainerStarted","Data":"21ce2efa4989dd164236421fa11e321a4382669ed4d7614649c55a6c542ebbf8"} Jun 09 15:14:09.787186 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.787152 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" event={"ID":"dfb6445305ea38939422cb2d303894d8","Type":"ContainerStarted","Data":"da72c037623634f5a90059e657429b5aeeb7cb2a2e3094df691a901c6c4f6bd7"} Jun 09 15:14:09.801549 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:09.801032 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-252.ec2.internal" podStartSLOduration=2.801010415 podStartE2EDuration="2.801010415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:09.80026392 +0000 UTC m=+4.608022827" watchObservedRunningTime="2026-06-09 15:14:09.801010415 +0000 UTC m=+4.608769324" Jun 09 15:14:10.681192 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:10.681159 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:10.681679 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:10.681303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:10.797054 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:10.797017 2566 generic.go:356] "Generic (PLEG): container finished" podID="3bb22ede631809705c4509fe15abe13f" containerID="311c94f4cc752f9c218aad5e61e59563dac65ea7dcb6c9d8a732067247bae213" exitCode=0 Jun 09 15:14:10.797584 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:10.797557 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" event={"ID":"3bb22ede631809705c4509fe15abe13f","Type":"ContainerDied","Data":"311c94f4cc752f9c218aad5e61e59563dac65ea7dcb6c9d8a732067247bae213"} Jun 09 15:14:10.797712 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:10.797608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" event={"ID":"3bb22ede631809705c4509fe15abe13f","Type":"ContainerStarted","Data":"942afa58b001b44b07638fb3cc55e1d1ee37828b2c5517d4a869a664d8001602"} Jun 09 15:14:10.814109 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:10.814050 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-252.ec2.internal" podStartSLOduration=3.814028479 podStartE2EDuration="3.814028479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:10.813034178 +0000 UTC m=+5.620793086" watchObservedRunningTime="2026-06-09 15:14:10.814028479 +0000 UTC m=+5.621787387" Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:11.351163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:11.351223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:11.351295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351367 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351435 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351443 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:15.351422575 +0000 UTC m=+10.159181473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351452 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351465 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351513 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:15.351498829 +0000 UTC m=+10.159257720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351572 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:11.351642 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.351603 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:15.351593126 +0000 UTC m=+10.159352014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:11.681297 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:11.680744 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:11.681297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.680889 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:11.682067 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:11.681893 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:11.682067 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:11.682020 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:12.681279 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:12.681243 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:12.681473 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:12.681431 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:13.680654 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:13.680604 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:13.680840 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:13.680733 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:13.681191 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:13.681172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:13.681269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:13.681250 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:14.680834 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:14.680803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:14.681255 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:14.680948 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:15.391535 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:15.391495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:15.391564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:15.391612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391628 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391701 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.391683708 +0000 UTC m=+18.199442592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391710 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:15.391721 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391718 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:15.392080 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391739 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:15.392080 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391751 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:15.392080 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391763 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.391750873 +0000 UTC m=+18.199509778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:15.392080 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.391793 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.391781075 +0000 UTC m=+18.199539978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:15.681431 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:15.681334 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:15.681431 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:15.681431 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:15.681938 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.681507 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:15.681938 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:15.681859 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:16.680876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:16.680820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:16.681087 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:16.680996 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:17.681043 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:17.681007 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:17.681477 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:17.681143 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:17.681477 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:17.681189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:17.681477 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:17.681307 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:18.681366 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:18.681335 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:18.681784 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:18.681471 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:19.681132 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:19.681027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:19.681320 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:19.681198 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:19.681320 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:19.681233 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:19.681757 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:19.681392 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:20.681291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:20.681260 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:20.681465 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:20.681364 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:21.681228 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:21.681192 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:21.681415 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:21.681313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:21.681869 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:21.681842 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:21.682279 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:21.681974 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:22.681097 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.680889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:22.681267 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:22.681176 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:22.825265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.825230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k95xk" event={"ID":"efcad9ff-12c0-4307-b0d7-d23c05a0ed6d","Type":"ContainerStarted","Data":"06ebca9e48695b04bc92d0c115cf0fcbe3d5b606f0b578eccf8fcb3474277758"} Jun 09 15:14:22.826949 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.826900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bl6s7" event={"ID":"cf2d5220-8d65-417c-9bbd-e40c1507718e","Type":"ContainerStarted","Data":"b3219a373e398604f6a0e527b2d3d3c5b57ef9bc160c64e48d777bdf955dafb8"} Jun 09 15:14:22.829504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.829477 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="2ba875ff274decc78f4e49fa731afe01d84be97b1efc83d90f66c844e88c0126" exitCode=0 Jun 09 15:14:22.829625 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.829552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"2ba875ff274decc78f4e49fa731afe01d84be97b1efc83d90f66c844e88c0126"} Jun 09 15:14:22.835147 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.832895 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wtck" event={"ID":"60e01511-a4ea-47cd-868e-e3776e149c9c","Type":"ContainerStarted","Data":"861a697629ac376338bb08f8bf9c1d7d178c73f9db1e2b6fcde9eb13dc0f837e"} Jun 09 15:14:22.837147 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.837122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zbmdc" event={"ID":"4889488a-3f1c-49a3-8ca4-8fe439dbb535","Type":"ContainerStarted","Data":"b71dbd5303a715ebf87cb0638418351487fa10903c2421dedc5e586a5e1a47be"} Jun 09 15:14:22.839089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.839047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc9j7" event={"ID":"422044bf-f7f5-4813-8c67-6f7c273176d8","Type":"ContainerStarted","Data":"918f9870bbc867bca5ce3c38627f5a5a7904435539af5dcb09752b421cdbef5d"} Jun 09 15:14:22.840540 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.840521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" event={"ID":"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305","Type":"ContainerStarted","Data":"0a3b329a2a0e2be9db7cc05872d8eaafcb19435965a6862125bb1d81ad1d2d8f"} Jun 09 15:14:22.842022 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.841976 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k95xk" podStartSLOduration=3.590560878 podStartE2EDuration="17.841960534s" totalImagesPullingTime="14.251399656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:22.841513257 +0000 UTC m=+17.649272161" watchObservedRunningTime="2026-06-09 15:14:22.841960534 +0000 UTC m=+17.649719441" Jun 09 15:14:22.855724 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.855673 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zbmdc" podStartSLOduration=3.841197504 podStartE2EDuration="16.855661097s" totalImagesPullingTime="13.014463593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:22.855206577 +0000 UTC m=+17.662965483" watchObservedRunningTime="2026-06-09 15:14:22.855661097 +0000 UTC m=+17.663420004" Jun 09 15:14:22.905467 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.905200 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9wtck" podStartSLOduration=3.682827835 podStartE2EDuration="17.905180709s" totalImagesPullingTime="14.222352874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:22.880282628 +0000 UTC m=+17.688041535" watchObservedRunningTime="2026-06-09 15:14:22.905180709 +0000 UTC m=+17.712939617" Jun 09 15:14:22.920551 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.920487 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bl6s7" podStartSLOduration=3.897841379 podStartE2EDuration="16.920468397s" totalImagesPullingTime="13.022627018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:22.920438399 +0000 UTC m=+17.728197307" watchObservedRunningTime="2026-06-09 15:14:22.920468397 +0000 UTC m=+17.728227304" Jun 09 15:14:22.947349 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:22.947230 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sc9j7" podStartSLOduration=3.852241325 podStartE2EDuration="16.947213248s" totalImagesPullingTime="13.094971923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:22.946127981 +0000 UTC m=+17.753886910" watchObservedRunningTime="2026-06-09 15:14:22.947213248 +0000 UTC m=+17.754972155" Jun 09 15:14:23.458738 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.458642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:23.458738 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.458702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.458744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458820 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458869 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458888 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:39.458873448 +0000 UTC m=+34.266632336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458891 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458927 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458955 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.458935 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:39.458900609 +0000 UTC m=+34.266659514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:23.459008 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.459001 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:39.458989288 +0000 UTC m=+34.266748177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:23.676556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.676529 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:14:23.680670 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.680643 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:23.680793 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.680760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:23.680856 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.680819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:23.680952 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:23.680930 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:23.843643 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.843555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zvx27" event={"ID":"901527d2-6ef7-40fd-bfba-775e391d5493","Type":"ContainerStarted","Data":"2958c0345a1f77acf2f7be2c6c8875d4578c51914b124e9824225f47a8dc73a0"} Jun 09 15:14:23.845673 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.845644 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" event={"ID":"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305","Type":"ContainerStarted","Data":"74283061a65baeb470a31debe8432ca34a06c844170f0f82c7a23c9b6550c2a8"} Jun 09 15:14:23.858571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:23.858528 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zvx27" podStartSLOduration=4.778208087 podStartE2EDuration="17.85851112s" totalImagesPullingTime="13.080303033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:23.858022344 +0000 UTC m=+18.665781250" watchObservedRunningTime="2026-06-09 15:14:23.85851112 +0000 UTC m=+18.666270025" Jun 09 15:14:24.668143 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:24.668035 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:14:23.676549983Z","UUID":"6fa119de-6511-448c-a412-f3d0c68657fc","Handler":null,"Name":"","Endpoint":""} Jun 09 15:14:24.669763 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:24.669718 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:14:24.669763 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:24.669763 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:14:24.680494 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:24.680465 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:24.680635 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:24.680599 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:25.681506 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:25.681470 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:25.681988 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:25.681595 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:25.681988 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:25.681882 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:25.682112 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:25.682001 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:26.075453 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:26.075189 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:26.075875 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:26.075855 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:26.681329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:26.681294 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:26.681507 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:26.681429 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:27.681200 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:27.681167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:27.681200 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:27.681199 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:27.681866 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:27.681296 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:27.681866 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:27.681383 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:28.680929 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:28.680885 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:28.681159 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:28.681009 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:28.861368 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:28.861339 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:28.861763 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:28.861462 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:14:28.861925 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:28.861897 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9wtck" Jun 09 15:14:29.681046 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:29.681016 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:29.681227 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:29.681022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:29.681227 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:29.681156 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:29.681345 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:29.681221 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:30.680749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:30.680716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:30.681145 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:30.680826 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:31.680689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.680429 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:31.680884 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.680486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:31.680884 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:31.680798 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:31.680884 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:31.680843 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:31.865037 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.864997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" event={"ID":"8ab0b5de-9b44-4d32-bf3b-8a1d20c81305","Type":"ContainerStarted","Data":"37960635e749b198385e7d08bf9cf6433e1463d75b0f9d5cbee52938ae0ae122"} Jun 09 15:14:31.866706 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.866683 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="63dd83c1aed31be601cff3d02a2e3d9bbcc8a47231652df098c506ceceb8b1cd" exitCode=0 Jun 09 15:14:31.866875 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.866780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"63dd83c1aed31be601cff3d02a2e3d9bbcc8a47231652df098c506ceceb8b1cd"} Jun 09 15:14:31.869513 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869497 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:14:31.869805 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869786 2566 generic.go:356] "Generic (PLEG): container finished" podID="4dd834e1-653d-4b9f-8dbd-44d275786efd" containerID="7c3584a6c6c074ebd7c749e47d7bb0748497720876940c0c13191ef459a05eb0" exitCode=1 Jun 09 15:14:31.869923 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"6f38e1b0114f02eb746b7f134cd3435de207fb9f21d39ed8e1b8dfdbb3b992c8"} Jun 09 15:14:31.869923 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"f259f73085b682ac429d81dcb469acf70de73ab27ec2e5b67ed848499f63b56c"} Jun 09 15:14:31.870033 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"049802afb8f26ef4abc0e7f54c0dea8561bf4c3ce64f485b49c0f1ead0a4710f"} Jun 09 15:14:31.870033 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.869997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"c9cdbb4aa795b0bf474e4cd61468af1cc72f943ed92fd53abf180641e175c1bc"} Jun 09 15:14:31.870127 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.870043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerDied","Data":"7c3584a6c6c074ebd7c749e47d7bb0748497720876940c0c13191ef459a05eb0"} Jun 09 15:14:31.870127 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.870091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"0617a6087e2ea7494c39238ec9e48fe72e3780e1a1f0ce17b39d22a3e9ed386e"} Jun 09 15:14:31.882170 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:31.882134 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-blsrx" podStartSLOduration=4.195557427 podStartE2EDuration="26.882122646s" totalImagesPullingTime="22.686565219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:31.880540911 +0000 UTC m=+26.688299807" watchObservedRunningTime="2026-06-09 15:14:31.882122646 +0000 UTC m=+26.689881552" Jun 09 15:14:32.681112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:32.681084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:32.681550 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:32.681184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:33.680554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.680523 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:33.680554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.680544 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:33.680785 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:33.680635 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:33.680848 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:33.680782 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:33.876442 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.876353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:14:33.876897 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.876707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"b1d5a633f617905510fc52e990e7e939fe51a9970a3d305ba7a6d65aa4bce289"} Jun 09 15:14:33.878586 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.878564 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="9e05dc47339744cea8ff31b2f19237f72cb4363e0920b0c7b7fb3f5357e96155" exitCode=0 Jun 09 15:14:33.878695 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:33.878595 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"9e05dc47339744cea8ff31b2f19237f72cb4363e0920b0c7b7fb3f5357e96155"} Jun 09 15:14:34.680745 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:34.680711 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:34.680928 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:34.680821 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:35.681861 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.681813 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:35.682370 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:35.681928 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:35.682370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.681959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:35.682370 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:35.682042 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:35.884739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.884705 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="96ca85cb07b57f1907d4a0c833259f0fc01cb8c934af79b55d037d4df261f723" exitCode=0 Jun 09 15:14:35.884920 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.884785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"96ca85cb07b57f1907d4a0c833259f0fc01cb8c934af79b55d037d4df261f723"} Jun 09 15:14:35.888516 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.888360 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:14:35.888872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.888852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"d49ef92c58da36ed0a7f9bb496e707428eaba59c7c4595cd830fa2853f5064e1"} Jun 09 15:14:35.889126 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.889105 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:35.889290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.889276 2566 scope.go:117] "RemoveContainer" containerID="7c3584a6c6c074ebd7c749e47d7bb0748497720876940c0c13191ef459a05eb0" Jun 09 15:14:35.904743 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:35.904725 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:36.680796 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.680765 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:36.680998 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:36.680915 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:36.895451 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.895422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:14:36.896095 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.895802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" event={"ID":"4dd834e1-653d-4b9f-8dbd-44d275786efd","Type":"ContainerStarted","Data":"db3ccfad2fe00bd1085281467df67c33c280018b06e8ea52da686043c1f7a641"} Jun 09 15:14:36.896095 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.896049 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:36.896218 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.896204 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:36.912374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.912350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:14:36.925796 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:36.925736 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" podStartSLOduration=8.830013113 podStartE2EDuration="31.925715127s" totalImagesPullingTime="23.095702014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:36.925229869 +0000 UTC m=+31.732988810" watchObservedRunningTime="2026-06-09 15:14:36.925715127 +0000 UTC m=+31.733474034" Jun 09 15:14:37.680736 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:37.680704 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:37.680943 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:37.680831 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:37.680943 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:37.680865 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:37.680943 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:37.680936 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:38.034355 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.032898 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2lgj"] Jun 09 15:14:38.034355 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.033085 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:38.034355 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:38.033212 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:38.036237 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.036177 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6kfd"] Jun 09 15:14:38.036367 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.036319 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:38.036472 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:38.036445 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:38.036785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.036762 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdllv"] Jun 09 15:14:38.036870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:38.036857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:38.036973 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:38.036954 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:39.483223 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.483193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.483231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.483266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483375 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483378 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483419 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483435 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483441 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:11.483419421 +0000 UTC m=+66.291178319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483448 2566 projected.go:196] Error preparing data for projected volume kube-api-access-btgls for pod openshift-network-diagnostics/network-check-target-z6kfd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483458 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret podName:ccd77cb7-4dc7-4092-a1f6-80bde2ca4237 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:11.483448544 +0000 UTC m=+66.291207431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret") pod "global-pull-secret-syncer-r2lgj" (UID: "ccd77cb7-4dc7-4092-a1f6-80bde2ca4237") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:39.483719 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.483484 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls podName:c3915237-7035-45ba-8594-68eadf624941 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:11.483474619 +0000 UTC m=+66.291233508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btgls" (UniqueName: "kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls") pod "network-check-target-z6kfd" (UID: "c3915237-7035-45ba-8594-68eadf624941") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:39.681084 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.681044 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:39.681084 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.681086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:39.681371 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:39.681048 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:39.681371 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.681181 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:39.681371 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.681284 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:39.681514 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:39.681373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:40.907395 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:40.907195 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="940bb27a05c47e9bfe542d1fb9ca7cf9ff8ecaac4f29a93ff8cab87d3a248403" exitCode=0 Jun 09 15:14:40.907395 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:40.907270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"940bb27a05c47e9bfe542d1fb9ca7cf9ff8ecaac4f29a93ff8cab87d3a248403"} Jun 09 15:14:41.680756 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:41.680723 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:41.680960 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:41.680723 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:41.680960 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:41.680852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:41.680960 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:41.680853 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:41.681126 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:41.680955 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:41.681126 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:41.681025 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:41.912103 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:41.912069 2566 generic.go:356] "Generic (PLEG): container finished" podID="3758d68b-e5a7-4590-b678-a68239ccef32" containerID="5b85b2cb57974b303c07baae33a4798127f4c40a97d3bd8d1b6c659542ab8d30" exitCode=0 Jun 09 15:14:41.912553 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:41.912132 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerDied","Data":"5b85b2cb57974b303c07baae33a4798127f4c40a97d3bd8d1b6c659542ab8d30"} Jun 09 15:14:42.917129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:42.917094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" event={"ID":"3758d68b-e5a7-4590-b678-a68239ccef32","Type":"ContainerStarted","Data":"c94ffe6718af8b49683547389b1c9bcbc2d038fc36dd5e72d83180565b95641f"} Jun 09 15:14:42.939889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:42.939824 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c9cjv" podStartSLOduration=8.822503854 podStartE2EDuration="37.939807716s" totalImagesPullingTime="29.117303862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:42.938769595 +0000 UTC m=+37.746528502" watchObservedRunningTime="2026-06-09 15:14:42.939807716 +0000 UTC m=+37.747566605" Jun 09 15:14:43.681318 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:43.681281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:43.681500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:43.681291 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:43.681500 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:43.681406 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6kfd" podUID="c3915237-7035-45ba-8594-68eadf624941" Jun 09 15:14:43.681500 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:43.681417 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:43.681606 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:43.681504 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:14:43.681606 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:43.681589 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2lgj" podUID="ccd77cb7-4dc7-4092-a1f6-80bde2ca4237" Jun 09 15:14:44.046086 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.046004 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-252.ec2.internal" event="NodeReady" Jun 09 15:14:44.046449 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.046113 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:14:44.083775 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.083742 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:14:44.087970 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.087954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.090918 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.090879 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8hlqd"] Jun 09 15:14:44.090918 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.090894 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:14:44.091081 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.091066 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:14:44.091897 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.091880 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:14:44.091993 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.091936 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mbhxv\"" Jun 09 15:14:44.094956 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.094699 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.097662 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.097643 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:14:44.097801 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.097646 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:14:44.097990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.097975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:14:44.098043 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.098002 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:14:44.098299 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.098270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:14:44.101079 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.101059 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7rz4p"] Jun 09 15:14:44.104939 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.104920 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8hlqd"] Jun 09 15:14:44.105017 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.104983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.107866 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.107846 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:14:44.107965 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.107886 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:14:44.107965 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.107849 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wh9pq\"" Jun 09 15:14:44.108224 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.108184 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:14:44.114724 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.114695 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7rz4p"] Jun 09 15:14:44.222824 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.222788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.222848 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.222959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.222987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tfj\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223083 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-tmp-dir\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-config-volume\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.223208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklq2\" (UniqueName: \"kubernetes.io/projected/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-kube-api-access-vklq2\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.223400 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e1ca5f-73be-4031-aae2-238f6fc401b3-cert\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.223400 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.223237 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hrmf\" (UniqueName: \"kubernetes.io/projected/a4e1ca5f-73be-4031-aae2-238f6fc401b3-kube-api-access-5hrmf\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.324175 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324175 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324362 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324362 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tfj\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324362 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324502 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.324389 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:44.324502 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.324403 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:44.324502 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.324453 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:44.824434709 +0000 UTC m=+39.632193598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:44.324502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.324502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-tmp-dir\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-config-volume\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.324575 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklq2\" (UniqueName: \"kubernetes.io/projected/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-kube-api-access-vklq2\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e1ca5f-73be-4031-aae2-238f6fc401b3-cert\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.324632 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:44.824616 +0000 UTC m=+39.632374901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hrmf\" (UniqueName: \"kubernetes.io/projected/a4e1ca5f-73be-4031-aae2-238f6fc401b3-kube-api-access-5hrmf\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.324708 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.325112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.325112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.324741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.325112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.325022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-tmp-dir\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.325112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.325099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.325386 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.325363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-config-volume\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.326269 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.326243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.328554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.328536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.328642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.328564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e1ca5f-73be-4031-aae2-238f6fc401b3-cert\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.328642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.328570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.332899 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.332878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.333156 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.333130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklq2\" (UniqueName: \"kubernetes.io/projected/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-kube-api-access-vklq2\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.333592 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.333571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hrmf\" (UniqueName: \"kubernetes.io/projected/a4e1ca5f-73be-4031-aae2-238f6fc401b3-kube-api-access-5hrmf\") pod \"ingress-canary-7rz4p\" (UID: \"a4e1ca5f-73be-4031-aae2-238f6fc401b3\") " pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.333656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.333602 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tfj\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.413398 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.413345 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7rz4p" Jun 09 15:14:44.543664 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.543496 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7rz4p"] Jun 09 15:14:44.546812 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:14:44.546781 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e1ca5f_73be_4031_aae2_238f6fc401b3.slice/crio-1b305042c6c6686330ef4a49fe640f9b9be841531e89f6695a8462ea93146847 WatchSource:0}: Error finding container 1b305042c6c6686330ef4a49fe640f9b9be841531e89f6695a8462ea93146847: Status 404 returned error can't find the container with id 1b305042c6c6686330ef4a49fe640f9b9be841531e89f6695a8462ea93146847 Jun 09 15:14:44.829979 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.829921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:44.830165 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.830003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:44.830165 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.830024 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:44.830165 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.830040 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:44.830165 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.830100 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:45.830079459 +0000 UTC m=+40.637838367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:44.830165 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.830145 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:44.830329 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:44.830197 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:45.830183739 +0000 UTC m=+40.637942624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:14:44.922688 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:44.922652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7rz4p" event={"ID":"a4e1ca5f-73be-4031-aae2-238f6fc401b3","Type":"ContainerStarted","Data":"1b305042c6c6686330ef4a49fe640f9b9be841531e89f6695a8462ea93146847"} Jun 09 15:14:45.681189 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.681161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:14:45.681747 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.681374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:14:45.681747 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.681510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:14:45.684212 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.684192 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:14:45.684333 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.684219 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:14:45.685408 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.685387 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:14:45.685524 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.685406 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:14:45.685524 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.685422 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:14:45.685524 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.685513 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:14:45.838010 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.837972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:45.838010 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:45.838007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:45.838269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:45.838127 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:45.838269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:45.838143 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:45.838269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:45.838194 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:47.838180558 +0000 UTC m=+42.645939446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:45.838269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:45.838143 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:45.838269 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:45.838252 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:47.838242177 +0000 UTC m=+42.646001079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:14:47.849660 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:47.849621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:47.849660 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:47.849657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:47.850083 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:47.849751 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:47.850083 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:47.849756 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:47.850083 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:47.849773 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:47.850083 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:47.849800 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:51.84978711 +0000 UTC m=+46.657545995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:14:47.850083 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:47.849813 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:51.849806959 +0000 UTC m=+46.657565844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:48.932452 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:48.932419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7rz4p" event={"ID":"a4e1ca5f-73be-4031-aae2-238f6fc401b3","Type":"ContainerStarted","Data":"1f0eae3f8f8045566c1ce075bd4f8e67efd0e70c7843d3c0626540224055c6af"} Jun 09 15:14:48.946481 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:48.946438 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7rz4p" podStartSLOduration=1.586641674 podStartE2EDuration="4.94642306s" totalImagesPullingTime="3.359781386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:48.946306902 +0000 UTC m=+43.754065842" watchObservedRunningTime="2026-06-09 15:14:48.94642306 +0000 UTC m=+43.754181967" Jun 09 15:14:51.877598 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:51.877557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:51.877598 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:51.877610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:51.878074 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:51.877724 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:51.878074 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:51.877738 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:51.878074 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:51.877782 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:51.878074 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:51.877813 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:59.877794094 +0000 UTC m=+54.685552985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:51.878074 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:51.877840 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:59.877821834 +0000 UTC m=+54.685580743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:14:59.939302 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:59.939066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:14:59.939323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:59.939220 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:59.939400 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:59.939449 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:59.939468 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:15.939450774 +0000 UTC m=+70.747209669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:14:59.939813 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:14:59.939514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:15.939496433 +0000 UTC m=+70.747255335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:15:08.910640 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:08.910614 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpxjc" Jun 09 15:15:11.530042 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.530001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:15:11.530042 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.530050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:15:11.530482 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.530081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:15:11.532992 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.532968 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:15:11.533111 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.533005 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:15:11.533111 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.533061 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:15:11.541045 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:11.541025 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:15:11.541126 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:11.541119 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:15.541102827 +0000 UTC m=+130.348861712 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : secret "metrics-daemon-secret" not found Jun 09 15:15:11.543163 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.543145 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:15:11.544838 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.544821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd77cb7-4dc7-4092-a1f6-80bde2ca4237-original-pull-secret\") pod \"global-pull-secret-syncer-r2lgj\" (UID: \"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237\") " pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:15:11.553247 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.553229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgls\" (UniqueName: \"kubernetes.io/projected/c3915237-7035-45ba-8594-68eadf624941-kube-api-access-btgls\") pod \"network-check-target-z6kfd\" (UID: \"c3915237-7035-45ba-8594-68eadf624941\") " pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:15:11.794377 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.794291 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:15:11.797298 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.797285 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2lgj" Jun 09 15:15:11.802286 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.802267 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:15:11.928508 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.928475 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2lgj"] Jun 09 15:15:11.931419 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:15:11.931396 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd77cb7_4dc7_4092_a1f6_80bde2ca4237.slice/crio-4b49b0a7c429400772fd01b493678a8057d56174d356cbc199b654627fe85204 WatchSource:0}: Error finding container 4b49b0a7c429400772fd01b493678a8057d56174d356cbc199b654627fe85204: Status 404 returned error can't find the container with id 4b49b0a7c429400772fd01b493678a8057d56174d356cbc199b654627fe85204 Jun 09 15:15:11.943691 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.943667 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6kfd"] Jun 09 15:15:11.947146 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:15:11.947125 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3915237_7035_45ba_8594_68eadf624941.slice/crio-a66433ce4f1d212dad091d54cbaaf56fa453051da8576079b8edfe474ac13f4f WatchSource:0}: Error finding container a66433ce4f1d212dad091d54cbaaf56fa453051da8576079b8edfe474ac13f4f: Status 404 returned error can't find the container with id a66433ce4f1d212dad091d54cbaaf56fa453051da8576079b8edfe474ac13f4f Jun 09 15:15:11.986278 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.986249 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6kfd" event={"ID":"c3915237-7035-45ba-8594-68eadf624941","Type":"ContainerStarted","Data":"a66433ce4f1d212dad091d54cbaaf56fa453051da8576079b8edfe474ac13f4f"} Jun 09 15:15:11.987340 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:11.987319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2lgj" event={"ID":"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237","Type":"ContainerStarted","Data":"4b49b0a7c429400772fd01b493678a8057d56174d356cbc199b654627fe85204"} Jun 09 15:15:14.997326 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:14.997289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6kfd" event={"ID":"c3915237-7035-45ba-8594-68eadf624941","Type":"ContainerStarted","Data":"403a12386dff0a4bab82684416e498631071bce26d2c935650b5e7f275e41c3c"} Jun 09 15:15:14.997717 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:14.997386 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:15:15.019817 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:15.019730 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6kfd" podStartSLOduration=67.199373535 podStartE2EDuration="1m10.019717181s" totalImagesPullingTime="2.820343646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:15.01887333 +0000 UTC m=+69.826632238" watchObservedRunningTime="2026-06-09 15:15:15.019717181 +0000 UTC m=+69.827476066" Jun 09 15:15:15.965981 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:15.965941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:15:15.965981 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:15.965980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:15:15.966238 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:15.966097 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:15.966238 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:15.966110 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:15:15.966238 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:15.966134 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:15:15.966238 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:15.966161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:47.966142838 +0000 UTC m=+102.773901726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:15:15.966238 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:15.966186 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:47.966170028 +0000 UTC m=+102.773928929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:15:17.041955 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.041811 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl"] Jun 09 15:15:17.045031 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.045006 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.048931 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.048886 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 15:15:17.048931 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.048886 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 15:15:17.049112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.048886 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 15:15:17.049112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.048891 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 15:15:17.055179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.054667 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl"] Jun 09 15:15:17.173733 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.173682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd09eef6-0a75-4d07-9a77-60a61c741650-tmp\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.173946 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.173759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd09eef6-0a75-4d07-9a77-60a61c741650-klusterlet-config\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.173946 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.173820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hf5\" (UniqueName: \"kubernetes.io/projected/bd09eef6-0a75-4d07-9a77-60a61c741650-kube-api-access-96hf5\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.275119 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.275074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd09eef6-0a75-4d07-9a77-60a61c741650-tmp\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.275292 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.275143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd09eef6-0a75-4d07-9a77-60a61c741650-klusterlet-config\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.275292 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.275178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hf5\" (UniqueName: \"kubernetes.io/projected/bd09eef6-0a75-4d07-9a77-60a61c741650-kube-api-access-96hf5\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.275579 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.275554 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd09eef6-0a75-4d07-9a77-60a61c741650-tmp\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.277749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.277726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd09eef6-0a75-4d07-9a77-60a61c741650-klusterlet-config\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.283788 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.283760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hf5\" (UniqueName: \"kubernetes.io/projected/bd09eef6-0a75-4d07-9a77-60a61c741650-kube-api-access-96hf5\") pod \"klusterlet-addon-workmgr-659ffd8b7b-946gl\" (UID: \"bd09eef6-0a75-4d07-9a77-60a61c741650\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:17.358492 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:17.358398 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:18.357474 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:18.357447 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl"] Jun 09 15:15:18.361272 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:15:18.361243 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd09eef6_0a75_4d07_9a77_60a61c741650.slice/crio-d3a50bd4c8b2b8bee12d57119f8c7646f6d72f6495fa960679dad0c43e67786f WatchSource:0}: Error finding container d3a50bd4c8b2b8bee12d57119f8c7646f6d72f6495fa960679dad0c43e67786f: Status 404 returned error can't find the container with id d3a50bd4c8b2b8bee12d57119f8c7646f6d72f6495fa960679dad0c43e67786f Jun 09 15:15:19.009165 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:19.009128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" event={"ID":"bd09eef6-0a75-4d07-9a77-60a61c741650","Type":"ContainerStarted","Data":"d3a50bd4c8b2b8bee12d57119f8c7646f6d72f6495fa960679dad0c43e67786f"} Jun 09 15:15:19.010490 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:19.010465 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2lgj" event={"ID":"ccd77cb7-4dc7-4092-a1f6-80bde2ca4237","Type":"ContainerStarted","Data":"529d0857ee64ce73a24cdbd3920274d8c456c984b7f7a06b090a6da206064950"} Jun 09 15:15:19.026349 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:19.026303 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r2lgj" podStartSLOduration=66.673097282 podStartE2EDuration="1m13.026287467s" totalImagesPullingTime="6.353190185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:19.025306797 +0000 UTC m=+73.833065704" watchObservedRunningTime="2026-06-09 15:15:19.026287467 +0000 UTC m=+73.834046375" Jun 09 15:15:23.023304 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:23.023267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" event={"ID":"bd09eef6-0a75-4d07-9a77-60a61c741650","Type":"ContainerStarted","Data":"c8f3fabdf2ee7d867aed88cbf257f30f1ed546b472f5ef996556738ffd89d722"} Jun 09 15:15:23.023746 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:23.023476 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:23.025107 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:23.025087 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:15:23.040093 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:23.040045 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" podStartSLOduration=1.943916675 podStartE2EDuration="6.040033376s" totalImagesPullingTime="4.096116701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:23.040006845 +0000 UTC m=+77.847765752" watchObservedRunningTime="2026-06-09 15:15:23.040033376 +0000 UTC m=+77.847792282" Jun 09 15:15:46.002647 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:46.002609 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6kfd" Jun 09 15:15:48.013025 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:48.012984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:15:48.013025 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:15:48.013026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:15:48.013455 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:48.013138 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:48.013455 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:48.013190 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:52.013175644 +0000 UTC m=+166.820934529 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:15:48.013455 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:48.013142 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:15:48.013455 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:48.013229 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:15:48.013455 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:15:48.013281 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:52.013270004 +0000 UTC m=+166.821028906 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:16:15.615851 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:16:15.615793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:16:15.616364 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:15.615964 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:16:15.616364 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:15.616044 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:17.616026038 +0000 UTC m=+252.423784923 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : secret "metrics-daemon-secret" not found Jun 09 15:16:47.101211 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:47.098254 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" Jun 09 15:16:47.104590 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:47.104562 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8hlqd" podUID="89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085" Jun 09 15:16:47.229468 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:16:47.229436 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:16:47.229636 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:16:47.229445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:16:48.702489 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:48.702432 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:16:52.070788 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:16:52.070739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:16:52.070788 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:16:52.070792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:16:52.071297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:52.070924 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:16:52.071297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:52.070945 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6758795dd6-p9q27: secret "image-registry-tls" not found Jun 09 15:16:52.071297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:52.070977 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:16:52.071297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:52.071004 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls podName:6a6cf237-deb6-49cb-abfd-889ae9ecce52 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:54.070984489 +0000 UTC m=+288.878743392 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls") pod "image-registry-6758795dd6-p9q27" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52") : secret "image-registry-tls" not found Jun 09 15:16:52.071297 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:16:52.071040 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls podName:89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:54.071023313 +0000 UTC m=+288.878782198 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls") pod "dns-default-8hlqd" (UID: "89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085") : secret "dns-default-metrics-tls" not found Jun 09 15:17:02.680683 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:02.680641 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:17:23.023810 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:23.023759 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" podUID="bd09eef6-0a75-4d07-9a77-60a61c741650" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 09 15:17:23.320729 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:23.320644 2566 generic.go:356] "Generic (PLEG): container finished" podID="bd09eef6-0a75-4d07-9a77-60a61c741650" containerID="c8f3fabdf2ee7d867aed88cbf257f30f1ed546b472f5ef996556738ffd89d722" exitCode=1 Jun 09 15:17:23.320729 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:23.320685 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" event={"ID":"bd09eef6-0a75-4d07-9a77-60a61c741650","Type":"ContainerDied","Data":"c8f3fabdf2ee7d867aed88cbf257f30f1ed546b472f5ef996556738ffd89d722"} Jun 09 15:17:23.321040 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:23.321027 2566 scope.go:117] "RemoveContainer" containerID="c8f3fabdf2ee7d867aed88cbf257f30f1ed546b472f5ef996556738ffd89d722" Jun 09 15:17:24.325813 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:24.325773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" event={"ID":"bd09eef6-0a75-4d07-9a77-60a61c741650","Type":"ContainerStarted","Data":"1c81fc2abe1a3e801a91933ccb8fb56c776fe54642d0e5369f0dc14f32768fed"} Jun 09 15:17:24.326276 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:24.326135 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:17:24.326731 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:17:24.326710 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-659ffd8b7b-946gl" Jun 09 15:18:02.781934 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.781888 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-pp6sc"] Jun 09 15:18:02.784781 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.784764 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.786172 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.786146 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr"] Jun 09 15:18:02.788198 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.788178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6x94j\"" Jun 09 15:18:02.788288 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.788269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.788783 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.788767 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.789529 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.789507 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 15:18:02.789615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.789549 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.789615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.789513 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 15:18:02.802356 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.802334 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 15:18:02.802580 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.802454 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tpr4t\"" Jun 09 15:18:02.802674 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.802456 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 15:18:02.803509 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.803488 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pp6sc"] Jun 09 15:18:02.803873 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.803859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 15:18:02.806521 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.806502 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr"] Jun 09 15:18:02.875296 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edecabf9-9a38-4937-bd9a-977114fac2b3-serving-cert\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.875296 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-tmp\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-trusted-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2m9t\" (UniqueName: \"kubernetes.io/projected/edecabf9-9a38-4937-bd9a-977114fac2b3-kube-api-access-b2m9t\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-snapshots\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.875504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.875502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-service-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.885441 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.885409 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw"] Jun 09 15:18:02.888345 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.888330 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:02.890997 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.890980 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.891216 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.891201 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-25jcc\"" Jun 09 15:18:02.891258 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.891200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 15:18:02.892791 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.892778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.905832 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.905809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw"] Jun 09 15:18:02.976274 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edecabf9-9a38-4937-bd9a-977114fac2b3-serving-cert\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.976274 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2m9t\" (UniqueName: \"kubernetes.io/projected/edecabf9-9a38-4937-bd9a-977114fac2b3-kube-api-access-b2m9t\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.976523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.976523 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:02.976382 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:02.976523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.976523 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:02.976446 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.476429877 +0000 UTC m=+238.284188762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:02.976523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-service-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.976785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:02.976785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-trusted-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.976785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-tmp\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.976785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsc4b\" (UniqueName: \"kubernetes.io/projected/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-kube-api-access-zsc4b\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:02.976785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-snapshots\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.977137 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.976956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-tmp\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.977137 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.977052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-service-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.977247 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.977216 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:02.977354 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.977331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edecabf9-9a38-4937-bd9a-977114fac2b3-snapshots\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.977532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.977516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edecabf9-9a38-4937-bd9a-977114fac2b3-trusted-ca-bundle\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.978717 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.978698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edecabf9-9a38-4937-bd9a-977114fac2b3-serving-cert\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:02.990316 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:02.990293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2m9t\" (UniqueName: \"kubernetes.io/projected/edecabf9-9a38-4937-bd9a-977114fac2b3-kube-api-access-b2m9t\") pod \"insights-operator-896549976-pp6sc\" (UID: \"edecabf9-9a38-4937-bd9a-977114fac2b3\") " pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:03.077818 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.077727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:03.077818 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.077771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsc4b\" (UniqueName: \"kubernetes.io/projected/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-kube-api-access-zsc4b\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:03.078054 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.077880 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:18:03.078054 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.077987 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls podName:abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.577970794 +0000 UTC m=+238.385729679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hwhzw" (UID: "abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c") : secret "samples-operator-tls" not found Jun 09 15:18:03.088711 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.088677 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsc4b\" (UniqueName: \"kubernetes.io/projected/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-kube-api-access-zsc4b\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:03.095483 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.095462 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pp6sc" Jun 09 15:18:03.222310 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.222278 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pp6sc"] Jun 09 15:18:03.225115 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:03.225085 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedecabf9_9a38_4937_bd9a_977114fac2b3.slice/crio-e6e1cd31910190f2fba7c4d97be0eefc16e2490ae569990ae3fad71025d77396 WatchSource:0}: Error finding container e6e1cd31910190f2fba7c4d97be0eefc16e2490ae569990ae3fad71025d77396: Status 404 returned error can't find the container with id e6e1cd31910190f2fba7c4d97be0eefc16e2490ae569990ae3fad71025d77396 Jun 09 15:18:03.432922 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.432878 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp6sc" event={"ID":"edecabf9-9a38-4937-bd9a-977114fac2b3","Type":"ContainerStarted","Data":"e6e1cd31910190f2fba7c4d97be0eefc16e2490ae569990ae3fad71025d77396"} Jun 09 15:18:03.481490 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.481450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:03.481666 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.481610 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:03.481707 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.481674 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.481658683 +0000 UTC m=+239.289417568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:03.582169 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:03.582133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:03.582324 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.582289 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:18:03.582363 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:03.582351 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls podName:abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.58233352 +0000 UTC m=+239.390092410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hwhzw" (UID: "abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c") : secret "samples-operator-tls" not found Jun 09 15:18:04.490201 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:04.490149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:04.490621 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:04.490304 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:04.490621 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:04.490372 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.490353355 +0000 UTC m=+241.298112256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:04.591472 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:04.591440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:04.591605 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:04.591584 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:18:04.591666 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:04.591648 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls podName:abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.591633418 +0000 UTC m=+241.399392303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hwhzw" (UID: "abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c") : secret "samples-operator-tls" not found Jun 09 15:18:06.442371 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:06.442332 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp6sc" event={"ID":"edecabf9-9a38-4937-bd9a-977114fac2b3","Type":"ContainerStarted","Data":"ce6c33a14e9a2d7ef30c19751ccc7ca6720a5ddcd8e1c7f73f8bc79611306069"} Jun 09 15:18:06.461368 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:06.461313 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-pp6sc" podStartSLOduration=1.976667306 podStartE2EDuration="4.46129928s" totalImagesPullingTime="2.484631974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:06.460648943 +0000 UTC m=+241.268407851" watchObservedRunningTime="2026-06-09 15:18:06.46129928 +0000 UTC m=+241.269058187" Jun 09 15:18:06.505582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:06.505544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:06.505830 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:06.505701 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:06.505986 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:06.505877 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.505856375 +0000 UTC m=+245.313615262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:06.606774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:06.606729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:06.606971 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:06.606887 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:18:06.607022 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:06.606974 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls podName:abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.606957331 +0000 UTC m=+245.414716216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hwhzw" (UID: "abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c") : secret "samples-operator-tls" not found Jun 09 15:18:08.476766 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.476729 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6"] Jun 09 15:18:08.479832 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.479815 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" Jun 09 15:18:08.482615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.482586 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tbkjc\"" Jun 09 15:18:08.483557 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.483531 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 15:18:08.483682 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.483556 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:08.492126 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.492104 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6"] Jun 09 15:18:08.520758 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.520724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw76w\" (UniqueName: \"kubernetes.io/projected/48f364c8-fe59-449e-a7d5-aa0031893e8b-kube-api-access-gw76w\") pod \"migrator-955ffdf5f-46tv6\" (UID: \"48f364c8-fe59-449e-a7d5-aa0031893e8b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" Jun 09 15:18:08.621623 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.621569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw76w\" (UniqueName: \"kubernetes.io/projected/48f364c8-fe59-449e-a7d5-aa0031893e8b-kube-api-access-gw76w\") pod \"migrator-955ffdf5f-46tv6\" (UID: \"48f364c8-fe59-449e-a7d5-aa0031893e8b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" Jun 09 15:18:08.633972 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.633947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw76w\" (UniqueName: \"kubernetes.io/projected/48f364c8-fe59-449e-a7d5-aa0031893e8b-kube-api-access-gw76w\") pod \"migrator-955ffdf5f-46tv6\" (UID: \"48f364c8-fe59-449e-a7d5-aa0031893e8b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" Jun 09 15:18:08.789088 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.788985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" Jun 09 15:18:08.894486 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.894458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zbmdc_4889488a-3f1c-49a3-8ca4-8fe439dbb535/dns-node-resolver/0.log" Jun 09 15:18:08.916556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:08.916523 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6"] Jun 09 15:18:08.919446 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:08.919410 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f364c8_fe59_449e_a7d5_aa0031893e8b.slice/crio-5f157546d85d81e8e10ee2c02c2307010c51404ca2a26fa771a501a6c26d4caa WatchSource:0}: Error finding container 5f157546d85d81e8e10ee2c02c2307010c51404ca2a26fa771a501a6c26d4caa: Status 404 returned error can't find the container with id 5f157546d85d81e8e10ee2c02c2307010c51404ca2a26fa771a501a6c26d4caa Jun 09 15:18:09.455307 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:09.455177 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" event={"ID":"48f364c8-fe59-449e-a7d5-aa0031893e8b","Type":"ContainerStarted","Data":"5f157546d85d81e8e10ee2c02c2307010c51404ca2a26fa771a501a6c26d4caa"} Jun 09 15:18:09.694657 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:09.694623 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bl6s7_cf2d5220-8d65-417c-9bbd-e40c1507718e/node-ca/0.log" Jun 09 15:18:10.459412 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.459379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" event={"ID":"48f364c8-fe59-449e-a7d5-aa0031893e8b","Type":"ContainerStarted","Data":"211e2957b9f5abb549b8c408ebdcca5defe1b1d7c4d78fbf74a03791ffb8d8d5"} Jun 09 15:18:10.494554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.494527 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7rz4p_a4e1ca5f-73be-4031-aae2-238f6fc401b3/serve-healthcheck-canary/0.log" Jun 09 15:18:10.533789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.533758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:10.533980 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:10.533953 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:10.534055 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:10.534031 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.534009374 +0000 UTC m=+253.341768278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:10.634574 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.634483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:10.634731 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:10.634638 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:18:10.634731 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:10.634703 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls podName:abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.634687608 +0000 UTC m=+253.442446493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hwhzw" (UID: "abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c") : secret "samples-operator-tls" not found Jun 09 15:18:10.779164 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.779126 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2kc4d"] Jun 09 15:18:10.782114 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.782096 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.785778 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.785758 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 15:18:10.785872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.785802 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 15:18:10.787136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.787113 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8nc6m\"" Jun 09 15:18:10.787262 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.787138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 15:18:10.787262 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.787154 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 15:18:10.791132 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.791111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2kc4d"] Jun 09 15:18:10.837015 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.836977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/073263c3-ed98-47d0-8425-82185c57589b-signing-cabundle\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.837195 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.837094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/073263c3-ed98-47d0-8425-82185c57589b-signing-key\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.837195 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.837127 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gld5\" (UniqueName: \"kubernetes.io/projected/073263c3-ed98-47d0-8425-82185c57589b-kube-api-access-6gld5\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.938217 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.938175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/073263c3-ed98-47d0-8425-82185c57589b-signing-key\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.938217 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.938224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gld5\" (UniqueName: \"kubernetes.io/projected/073263c3-ed98-47d0-8425-82185c57589b-kube-api-access-6gld5\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.938426 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.938338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/073263c3-ed98-47d0-8425-82185c57589b-signing-cabundle\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.939032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.939010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/073263c3-ed98-47d0-8425-82185c57589b-signing-cabundle\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.940536 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.940519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/073263c3-ed98-47d0-8425-82185c57589b-signing-key\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:10.948175 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:10.948147 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gld5\" (UniqueName: \"kubernetes.io/projected/073263c3-ed98-47d0-8425-82185c57589b-kube-api-access-6gld5\") pod \"service-ca-7d74d578b8-2kc4d\" (UID: \"073263c3-ed98-47d0-8425-82185c57589b\") " pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:11.090958 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:11.090892 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" Jun 09 15:18:11.217133 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:11.216978 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2kc4d"] Jun 09 15:18:11.221775 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:11.221748 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073263c3_ed98_47d0_8425_82185c57589b.slice/crio-114b42eb4d73fcbd696b8216549dc56733a699e004d62a1815823bc260d34d05 WatchSource:0}: Error finding container 114b42eb4d73fcbd696b8216549dc56733a699e004d62a1815823bc260d34d05: Status 404 returned error can't find the container with id 114b42eb4d73fcbd696b8216549dc56733a699e004d62a1815823bc260d34d05 Jun 09 15:18:11.464204 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:11.464165 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" event={"ID":"48f364c8-fe59-449e-a7d5-aa0031893e8b","Type":"ContainerStarted","Data":"81258b58a7760a5e1573e5d9516b65b2fae62fd658ca3b12042438719b4118de"} Jun 09 15:18:11.465291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:11.465271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" event={"ID":"073263c3-ed98-47d0-8425-82185c57589b","Type":"ContainerStarted","Data":"114b42eb4d73fcbd696b8216549dc56733a699e004d62a1815823bc260d34d05"} Jun 09 15:18:11.524766 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:11.524662 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-46tv6" podStartSLOduration=2.071368593 podStartE2EDuration="3.524645834s" totalImagesPullingTime="1.453277241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:11.524538796 +0000 UTC m=+246.332297705" watchObservedRunningTime="2026-06-09 15:18:11.524645834 +0000 UTC m=+246.332404740" Jun 09 15:18:14.477378 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:14.476652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" event={"ID":"073263c3-ed98-47d0-8425-82185c57589b","Type":"ContainerStarted","Data":"8e6a6ef8bd2d9d33292ac4e90fc1a375f9dae35d2f51c9dcd135e4f480d42895"} Jun 09 15:18:17.692739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:17.692652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:18:17.693127 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:17.692800 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:18:17.693127 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:17.692867 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs podName:99f90c41-2169-4223-839f-c576cc1a5b03 nodeName:}" failed. No retries permitted until 2026-06-09 15:20:19.692849169 +0000 UTC m=+374.500608065 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs") pod "network-metrics-daemon-vdllv" (UID: "99f90c41-2169-4223-839f-c576cc1a5b03") : secret "metrics-daemon-secret" not found Jun 09 15:18:18.600536 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.600501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:18.600752 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:18.600684 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:18:18.600814 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:18.600764 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert podName:2ac4a5f8-5567-4c75-a7ed-aee537c9b953 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:34.600742151 +0000 UTC m=+269.408501045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-8b5jr" (UID: "2ac4a5f8-5567-4c75-a7ed-aee537c9b953") : secret "networking-console-plugin-cert" not found Jun 09 15:18:18.701028 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.700993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:18.703424 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.703396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hwhzw\" (UID: \"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:18.799276 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.799243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-25jcc\"" Jun 09 15:18:18.807657 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.807630 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" Jun 09 15:18:18.931753 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.931705 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-2kc4d" podStartSLOduration=6.431836604 podStartE2EDuration="8.931685837s" totalImagesPullingTime="2.499849233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:14.500860468 +0000 UTC m=+249.308619376" watchObservedRunningTime="2026-06-09 15:18:18.931685837 +0000 UTC m=+253.739444802" Jun 09 15:18:18.932376 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:18.932358 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw"] Jun 09 15:18:19.492282 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:19.492239 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" event={"ID":"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c","Type":"ContainerStarted","Data":"5031bbb19da2925c910d2de50ee0d9feec005311c09265a08a4fcf6d99e9b1a7"} Jun 09 15:18:21.502591 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:21.502557 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" event={"ID":"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c","Type":"ContainerStarted","Data":"af47133b6ff21076298629ec425a3039feeb0f841476b61ad3c1f3b30f10b48b"} Jun 09 15:18:22.507265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:22.507230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" event={"ID":"abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c","Type":"ContainerStarted","Data":"a59a5a0240f4822e047fc248f44fd4d4a04e1d62a9795fc38a709b4de24c1f35"} Jun 09 15:18:22.528516 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:22.528466 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hwhzw" podStartSLOduration=18.090540299 podStartE2EDuration="20.528449775s" totalImagesPullingTime="2.437909476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:22.527177383 +0000 UTC m=+257.334936291" watchObservedRunningTime="2026-06-09 15:18:22.528449775 +0000 UTC m=+257.336208681" Jun 09 15:18:33.117282 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.117245 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxjz"] Jun 09 15:18:33.120556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.120538 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.122988 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.122957 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:18:33.124230 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.124211 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:18:33.124230 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.124225 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlqlf\"" Jun 09 15:18:33.137116 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.137090 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxjz"] Jun 09 15:18:33.218710 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.218660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2lf\" (UniqueName: \"kubernetes.io/projected/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-api-access-2w2lf\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.218876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.218739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.218876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.218813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b87d2656-dcca-4a6d-9f02-6e954e6857c5-crio-socket\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.218876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.218844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b87d2656-dcca-4a6d-9f02-6e954e6857c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.219066 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.218992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b87d2656-dcca-4a6d-9f02-6e954e6857c5-data-volume\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319662 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b87d2656-dcca-4a6d-9f02-6e954e6857c5-crio-socket\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319693 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b87d2656-dcca-4a6d-9f02-6e954e6857c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b87d2656-dcca-4a6d-9f02-6e954e6857c5-data-volume\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2lf\" (UniqueName: \"kubernetes.io/projected/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-api-access-2w2lf\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.319850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.319779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b87d2656-dcca-4a6d-9f02-6e954e6857c5-crio-socket\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.320148 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.320127 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b87d2656-dcca-4a6d-9f02-6e954e6857c5-data-volume\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.320493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.320470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.322117 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.322096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b87d2656-dcca-4a6d-9f02-6e954e6857c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.329837 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.329817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2lf\" (UniqueName: \"kubernetes.io/projected/b87d2656-dcca-4a6d-9f02-6e954e6857c5-kube-api-access-2w2lf\") pod \"insights-runtime-extractor-8dxjz\" (UID: \"b87d2656-dcca-4a6d-9f02-6e954e6857c5\") " pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.429413 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.429373 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dxjz" Jun 09 15:18:33.555483 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:33.555452 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxjz"] Jun 09 15:18:33.559807 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:33.559778 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87d2656_dcca_4a6d_9f02_6e954e6857c5.slice/crio-1c6bf1c787a752ecd59568bb73e793da4250c8b13731f41e6e3eab0ef09ecdf3 WatchSource:0}: Error finding container 1c6bf1c787a752ecd59568bb73e793da4250c8b13731f41e6e3eab0ef09ecdf3: Status 404 returned error can't find the container with id 1c6bf1c787a752ecd59568bb73e793da4250c8b13731f41e6e3eab0ef09ecdf3 Jun 09 15:18:34.545184 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.545098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxjz" event={"ID":"b87d2656-dcca-4a6d-9f02-6e954e6857c5","Type":"ContainerStarted","Data":"38c5365c7c3bb1e2d9b9def240133f85f02e01f2bb6f854813ce7041a1a19fd0"} Jun 09 15:18:34.545184 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.545154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxjz" event={"ID":"b87d2656-dcca-4a6d-9f02-6e954e6857c5","Type":"ContainerStarted","Data":"7f0d3058ccda58c48612cd4e85b7e77dd40b2119302c4db15791230110901218"} Jun 09 15:18:34.545184 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.545174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxjz" event={"ID":"b87d2656-dcca-4a6d-9f02-6e954e6857c5","Type":"ContainerStarted","Data":"1c6bf1c787a752ecd59568bb73e793da4250c8b13731f41e6e3eab0ef09ecdf3"} Jun 09 15:18:34.629897 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.629867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:34.632215 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.632193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ac4a5f8-5567-4c75-a7ed-aee537c9b953-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-8b5jr\" (UID: \"2ac4a5f8-5567-4c75-a7ed-aee537c9b953\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:34.903791 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.903760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tpr4t\"" Jun 09 15:18:34.911052 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:34.911030 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" Jun 09 15:18:35.047185 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:35.047161 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr"] Jun 09 15:18:35.049484 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:35.049457 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac4a5f8_5567_4c75_a7ed_aee537c9b953.slice/crio-c8998c96a961c6a5766222c6e66796aa3ae3a6ce495addfdf247b0980ae54e4c WatchSource:0}: Error finding container c8998c96a961c6a5766222c6e66796aa3ae3a6ce495addfdf247b0980ae54e4c: Status 404 returned error can't find the container with id c8998c96a961c6a5766222c6e66796aa3ae3a6ce495addfdf247b0980ae54e4c Jun 09 15:18:35.549793 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:35.549758 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" event={"ID":"2ac4a5f8-5567-4c75-a7ed-aee537c9b953","Type":"ContainerStarted","Data":"c8998c96a961c6a5766222c6e66796aa3ae3a6ce495addfdf247b0980ae54e4c"} Jun 09 15:18:36.554946 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:36.554887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxjz" event={"ID":"b87d2656-dcca-4a6d-9f02-6e954e6857c5","Type":"ContainerStarted","Data":"ad832611ebd13afc86086e6fb8fc74f76c700e8dfe2a29ea3993cb89d9964fb1"} Jun 09 15:18:36.577209 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:36.577158 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8dxjz" podStartSLOduration=1.206780212 podStartE2EDuration="3.57714317s" totalImagesPullingTime="2.370362958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:36.575403501 +0000 UTC m=+271.383162407" watchObservedRunningTime="2026-06-09 15:18:36.57714317 +0000 UTC m=+271.384902076" Jun 09 15:18:37.559463 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:37.559375 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" event={"ID":"2ac4a5f8-5567-4c75-a7ed-aee537c9b953","Type":"ContainerStarted","Data":"d68c1357c3d6a05cefdb67d4bda713edf676f7ea3dc4ef618867a39c741175c9"} Jun 09 15:18:37.575948 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:37.575881 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-8b5jr" podStartSLOduration=33.345263515 podStartE2EDuration="35.57586677s" totalImagesPullingTime="2.230603255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:37.574733375 +0000 UTC m=+272.382492286" watchObservedRunningTime="2026-06-09 15:18:37.57586677 +0000 UTC m=+272.383625678" Jun 09 15:18:46.148830 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.148785 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wgzw7"] Jun 09 15:18:46.153265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.153246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.158669 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158605 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:18:46.158669 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158636 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:18:46.158669 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:18:46.158941 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158718 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzjz7\"" Jun 09 15:18:46.158941 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:18:46.159036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158954 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:18:46.159036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.158994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:18:46.316976 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.316938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-metrics-client-ca\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.316976 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.316985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-tls\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-root\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgrhc\" (UniqueName: \"kubernetes.io/projected/81ac1312-545f-4fcb-9a8b-37cba9adf196-kube-api-access-tgrhc\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317421 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-sys\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317421 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-textfile\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.317421 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.317338 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-wtmp\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.329166 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.329135 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:18:46.331974 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.331954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.335058 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335036 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:18:46.335168 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335115 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:18:46.335230 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:18:46.335287 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335221 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:18:46.335287 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9g5w9\"" Jun 09 15:18:46.335385 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335324 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:18:46.335385 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.335371 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:18:46.336291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.336275 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:18:46.344819 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.344799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:18:46.352001 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.351981 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:18:46.418689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-wtmp\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.418689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-metrics-client-ca\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.418689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418629 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-tls\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.418689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-root\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-wtmp\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgrhc\" (UniqueName: \"kubernetes.io/projected/81ac1312-545f-4fcb-9a8b-37cba9adf196-kube-api-access-tgrhc\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-sys\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418825 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-root\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.418832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-textfile\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419468 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.419238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-textfile\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419468 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.419433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-metrics-client-ca\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.419582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.419563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ac1312-545f-4fcb-9a8b-37cba9adf196-sys\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.420133 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.420103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.421991 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.421947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.422105 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.422086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81ac1312-545f-4fcb-9a8b-37cba9adf196-node-exporter-tls\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.432880 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.432855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgrhc\" (UniqueName: \"kubernetes.io/projected/81ac1312-545f-4fcb-9a8b-37cba9adf196-kube-api-access-tgrhc\") pod \"node-exporter-wgzw7\" (UID: \"81ac1312-545f-4fcb-9a8b-37cba9adf196\") " pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.462869 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.462832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wgzw7" Jun 09 15:18:46.475923 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:46.475875 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ac1312_545f_4fcb_9a8b_37cba9adf196.slice/crio-e9bd7bd42d6a7fdf2453f3db9386bcd7b5f93a454ba01a0d35919f585c407828 WatchSource:0}: Error finding container e9bd7bd42d6a7fdf2453f3db9386bcd7b5f93a454ba01a0d35919f585c407828: Status 404 returned error can't find the container with id e9bd7bd42d6a7fdf2453f3db9386bcd7b5f93a454ba01a0d35919f585c407828 Jun 09 15:18:46.519642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.519642 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.519894 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.519894 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.519894 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.519894 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.520136 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.519959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkwp9\" (UniqueName: \"kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.586986 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.586941 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgzw7" event={"ID":"81ac1312-545f-4fcb-9a8b-37cba9adf196","Type":"ContainerStarted","Data":"e9bd7bd42d6a7fdf2453f3db9386bcd7b5f93a454ba01a0d35919f585c407828"} Jun 09 15:18:46.620550 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620550 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkwp9\" (UniqueName: \"kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.620789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.620715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.621475 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.621450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.621590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.621499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.621590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.621507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.621803 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.621780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.623024 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.623007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.623341 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.623324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.646319 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.646293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkwp9\" (UniqueName: \"kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9\") pod \"console-7b94d9c7dd-gkdpr\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:46.941921 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:46.941876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:47.089653 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:47.089622 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:18:47.286621 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:47.286552 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fec85a_8252_4a8b_8735_7514c4d8fd69.slice/crio-f6fae1cfb9f4de9bb6c6a87dc82bde98c3de214c96228da528e68daf6d4b583a WatchSource:0}: Error finding container f6fae1cfb9f4de9bb6c6a87dc82bde98c3de214c96228da528e68daf6d4b583a: Status 404 returned error can't find the container with id f6fae1cfb9f4de9bb6c6a87dc82bde98c3de214c96228da528e68daf6d4b583a Jun 09 15:18:47.591583 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:47.591488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94d9c7dd-gkdpr" event={"ID":"d7fec85a-8252-4a8b-8735-7514c4d8fd69","Type":"ContainerStarted","Data":"f6fae1cfb9f4de9bb6c6a87dc82bde98c3de214c96228da528e68daf6d4b583a"} Jun 09 15:18:47.593013 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:47.592982 2566 generic.go:356] "Generic (PLEG): container finished" podID="81ac1312-545f-4fcb-9a8b-37cba9adf196" containerID="c274686469a209d62a64fe49b32e75c8096cbceb3f27e97d747fd8c69b83b2d6" exitCode=0 Jun 09 15:18:47.593150 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:47.593031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgzw7" event={"ID":"81ac1312-545f-4fcb-9a8b-37cba9adf196","Type":"ContainerDied","Data":"c274686469a209d62a64fe49b32e75c8096cbceb3f27e97d747fd8c69b83b2d6"} Jun 09 15:18:48.599743 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:48.599704 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgzw7" event={"ID":"81ac1312-545f-4fcb-9a8b-37cba9adf196","Type":"ContainerStarted","Data":"fa8e1c42bbaa26823825d4363dd53d9acee89677d399b18799cb0606ff191937"} Jun 09 15:18:48.600230 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:48.599773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgzw7" event={"ID":"81ac1312-545f-4fcb-9a8b-37cba9adf196","Type":"ContainerStarted","Data":"6abb5fdf8803522923eaff30796a0ec716618615924cc8b8963b98b76ade3fae"} Jun 09 15:18:49.089663 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.089609 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wgzw7" podStartSLOduration=2.17294793 podStartE2EDuration="3.089586172s" totalImagesPullingTime="852.413587ms" totalInitContainerRuntime="64.224655ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:48.649745367 +0000 UTC m=+283.457504278" watchObservedRunningTime="2026-06-09 15:18:49.089586172 +0000 UTC m=+283.897345083" Jun 09 15:18:49.089969 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.089953 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f769d897b-wlsc4"] Jun 09 15:18:49.093945 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.093900 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.098925 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.098888 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 15:18:49.100089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.100063 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x6jfv\"" Jun 09 15:18:49.100654 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.100636 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 15:18:49.100813 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.100644 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5jonq26nojfr0\"" Jun 09 15:18:49.102068 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.102047 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 15:18:49.102180 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.102097 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 15:18:49.104214 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.104192 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 15:18:49.115745 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.115710 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f769d897b-wlsc4"] Jun 09 15:18:49.244235 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244423 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244423 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsdws\" (UniqueName: \"kubernetes.io/projected/728848d6-4aa5-412a-ba75-0b37f39865f4-kube-api-access-jsdws\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244423 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728848d6-4aa5-412a-ba75-0b37f39865f4-metrics-client-ca\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244423 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-grpc-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244639 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244639 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.244639 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.244522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-grpc-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345770 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsdws\" (UniqueName: \"kubernetes.io/projected/728848d6-4aa5-412a-ba75-0b37f39865f4-kube-api-access-jsdws\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.345870 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.345808 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728848d6-4aa5-412a-ba75-0b37f39865f4-metrics-client-ca\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.346605 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.346544 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728848d6-4aa5-412a-ba75-0b37f39865f4-metrics-client-ca\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.349677 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.349629 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.349804 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.349704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-grpc-tls\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.349976 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.349951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.350220 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.350202 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.350356 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.350337 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.351060 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.351032 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/728848d6-4aa5-412a-ba75-0b37f39865f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.360282 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.360232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsdws\" (UniqueName: \"kubernetes.io/projected/728848d6-4aa5-412a-ba75-0b37f39865f4-kube-api-access-jsdws\") pod \"thanos-querier-6f769d897b-wlsc4\" (UID: \"728848d6-4aa5-412a-ba75-0b37f39865f4\") " pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:49.405169 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:49.404896 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:50.140985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.140952 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f769d897b-wlsc4"] Jun 09 15:18:50.230373 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:50.230329 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8hlqd" podUID="89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085" Jun 09 15:18:50.230373 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:50.230346 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" Jun 09 15:18:50.608562 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.608527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94d9c7dd-gkdpr" event={"ID":"d7fec85a-8252-4a8b-8735-7514c4d8fd69","Type":"ContainerStarted","Data":"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b"} Jun 09 15:18:50.609632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.609604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"32342a6c075f266e7fd9a562eb2a671a434d55e8cffb9795e8b2c70595783b56"} Jun 09 15:18:50.609632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.609621 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:18:50.609803 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.609640 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:18:50.635402 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.635341 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b94d9c7dd-gkdpr" podStartSLOduration=1.876054688 podStartE2EDuration="4.635324052s" totalImagesPullingTime="2.759269364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:50.634895486 +0000 UTC m=+285.442654393" watchObservedRunningTime="2026-06-09 15:18:50.635324052 +0000 UTC m=+285.443082959" Jun 09 15:18:50.903412 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.903376 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r62gl"] Jun 09 15:18:50.907080 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.907062 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:50.909850 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.909824 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-grs72\"" Jun 09 15:18:50.910145 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.910131 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 15:18:50.933177 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.933149 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r62gl"] Jun 09 15:18:50.948678 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.948650 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:18:50.951683 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.951668 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.958725 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.958844 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.958844 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.958972 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgdk\" (UniqueName: \"kubernetes.io/projected/d8cd9214-292a-4834-a6da-9fa3071ffa35-kube-api-access-ktgdk\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:50.958972 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.959041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.959041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.958997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjlh\" (UniqueName: \"kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.959041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.959024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:50.959154 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.959076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:50.969936 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:50.969892 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:18:51.060163 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.060332 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060186 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060332 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060332 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060269 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060332 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgdk\" (UniqueName: \"kubernetes.io/projected/d8cd9214-292a-4834-a6da-9fa3071ffa35-kube-api-access-ktgdk\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.060332 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjlh\" (UniqueName: \"kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.060457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.060590 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:51.060464 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 15:18:51.060590 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:18:51.060562 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert podName:d8cd9214-292a-4834-a6da-9fa3071ffa35 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:51.560542255 +0000 UTC m=+286.368301162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-r62gl" (UID: "d8cd9214-292a-4834-a6da-9fa3071ffa35") : secret "monitoring-plugin-cert" not found Jun 09 15:18:51.061233 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.061184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.061422 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.061398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.061618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.061599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.061704 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.061638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.063688 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.063664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.063789 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.063666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.081170 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.081121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjlh\" (UniqueName: \"kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh\") pod \"console-67f668dc79-fndbn\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.081762 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.081742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgdk\" (UniqueName: \"kubernetes.io/projected/d8cd9214-292a-4834-a6da-9fa3071ffa35-kube-api-access-ktgdk\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.260874 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.260798 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:18:51.391199 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.391151 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:18:51.395508 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:51.395481 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027478c2_b0c9_4ea3_93c7_f11fa4f072ec.slice/crio-1c51504a6fd6986d63ae87d88c71f7b5069a01d97e7ebd8374a3ebad20039af2 WatchSource:0}: Error finding container 1c51504a6fd6986d63ae87d88c71f7b5069a01d97e7ebd8374a3ebad20039af2: Status 404 returned error can't find the container with id 1c51504a6fd6986d63ae87d88c71f7b5069a01d97e7ebd8374a3ebad20039af2 Jun 09 15:18:51.564572 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.564489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.566882 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.566857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8cd9214-292a-4834-a6da-9fa3071ffa35-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r62gl\" (UID: \"d8cd9214-292a-4834-a6da-9fa3071ffa35\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.615296 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.615254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f668dc79-fndbn" event={"ID":"027478c2-b0c9-4ea3-93c7-f11fa4f072ec","Type":"ContainerStarted","Data":"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e"} Jun 09 15:18:51.615469 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.615321 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f668dc79-fndbn" event={"ID":"027478c2-b0c9-4ea3-93c7-f11fa4f072ec","Type":"ContainerStarted","Data":"1c51504a6fd6986d63ae87d88c71f7b5069a01d97e7ebd8374a3ebad20039af2"} Jun 09 15:18:51.649359 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.649299 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f668dc79-fndbn" podStartSLOduration=1.649280209 podStartE2EDuration="1.649280209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:51.648730132 +0000 UTC m=+286.456489052" watchObservedRunningTime="2026-06-09 15:18:51.649280209 +0000 UTC m=+286.457039117" Jun 09 15:18:51.817542 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.817457 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:51.962762 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:51.962697 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r62gl"] Jun 09 15:18:52.375815 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:52.375786 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8cd9214_292a_4834_a6da_9fa3071ffa35.slice/crio-7a722a2cceefee6c1efa26a04a45d920a87928ae85b7993d1653839bdd96926e WatchSource:0}: Error finding container 7a722a2cceefee6c1efa26a04a45d920a87928ae85b7993d1653839bdd96926e: Status 404 returned error can't find the container with id 7a722a2cceefee6c1efa26a04a45d920a87928ae85b7993d1653839bdd96926e Jun 09 15:18:52.564306 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.564276 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:18:52.574110 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.574086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.579315 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579291 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 15:18:52.579539 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579318 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 15:18:52.579620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4mvqtvhaqirlh\"" Jun 09 15:18:52.579620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 15:18:52.579719 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 15:18:52.579968 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.579948 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 15:18:52.580113 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.580100 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 15:18:52.581454 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.581437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 15:18:52.581537 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.581473 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 15:18:52.581869 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.581847 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 15:18:52.581977 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.581955 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 15:18:52.588652 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.588621 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 15:18:52.588934 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.588899 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:18:52.589032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.588938 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 15:18:52.589923 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.589894 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwrps\"" Jun 09 15:18:52.592047 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.592032 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 15:18:52.614044 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.614021 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 15:18:52.620955 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.620886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"901c73300b4dad45cbce54b03d4550889d6ee292ac6702e0bd9aa4199567aa2d"} Jun 09 15:18:52.621103 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.621030 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"7e51b356b7a135294e985a90ca9d5749a9fa878cf62a370591ef9f020ce7f7f0"} Jun 09 15:18:52.621103 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.621079 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"0379ae8bc1bf84228e1c1a55b0e8048c85e077200372c66d710c7d909de8a5ab"} Jun 09 15:18:52.622211 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.622187 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" event={"ID":"d8cd9214-292a-4834-a6da-9fa3071ffa35","Type":"ContainerStarted","Data":"7a722a2cceefee6c1efa26a04a45d920a87928ae85b7993d1653839bdd96926e"} Jun 09 15:18:52.624484 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.624464 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:18:52.674656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.674656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.674896 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.674896 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.674896 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.674896 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.674996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675372 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpd6z\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675372 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675372 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675372 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.675621 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.675509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776184 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpd6z\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776645 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776825 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.776994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.776891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.777380 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.777117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.777380 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.777179 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.779109 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.779084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.779680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.779659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.779856 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.779834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780047 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.779890 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780149 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780368 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780795 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780808 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780819 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.780872 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.780807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.781637 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.781599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.782244 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.782202 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.782330 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.782262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.782376 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.782335 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.782409 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.782386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.782503 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.782485 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.790006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.789897 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpd6z\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z\") pod \"prometheus-k8s-0\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:52.886471 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:52.886441 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:18:53.110402 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.110370 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:18:53.190970 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:53.190891 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d79623_1f76_4523_af54_74b054560408.slice/crio-d391dd078616f9234c68f7508c222d1f213fe6a634b870c568ac613ce7a1af29 WatchSource:0}: Error finding container d391dd078616f9234c68f7508c222d1f213fe6a634b870c568ac613ce7a1af29: Status 404 returned error can't find the container with id d391dd078616f9234c68f7508c222d1f213fe6a634b870c568ac613ce7a1af29 Jun 09 15:18:53.630692 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.630585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"b9cc9f1ff8e779aacc33dfed19ad3b19b95d8ddd8d5b3f2d5736aecfdde1efe8"} Jun 09 15:18:53.630692 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.630686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"1827dc48107d253a2c2fa3827bb9e758ba00b6a121b97e2da3c3340f75b76d0e"} Jun 09 15:18:53.631250 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.630738 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:53.631250 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.630779 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" event={"ID":"728848d6-4aa5-412a-ba75-0b37f39865f4","Type":"ContainerStarted","Data":"55042eea8a1efba34f23a905a10f6b2183120b42078909ddcd744bf6819393e9"} Jun 09 15:18:53.631962 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.631935 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"d391dd078616f9234c68f7508c222d1f213fe6a634b870c568ac613ce7a1af29"} Jun 09 15:18:53.675596 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:53.675297 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" podStartSLOduration=1.7635117280000001 podStartE2EDuration="4.675277281s" totalImagesPullingTime="2.911765553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:53.675183921 +0000 UTC m=+288.482942867" watchObservedRunningTime="2026-06-09 15:18:53.675277281 +0000 UTC m=+288.483036166" Jun 09 15:18:54.091725 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.091683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:18:54.091948 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.091740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:18:54.094329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.094301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085-metrics-tls\") pod \"dns-default-8hlqd\" (UID: \"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085\") " pod="openshift-dns/dns-default-8hlqd" Jun 09 15:18:54.094648 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.094625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"image-registry-6758795dd6-p9q27\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:18:54.213658 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.213576 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:18:54.214017 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.213999 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mbhxv\"" Jun 09 15:18:54.221638 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.221617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:18:54.221757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.221697 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:18:54.570259 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.570232 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8hlqd"] Jun 09 15:18:54.573781 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:54.573755 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fa0eeb_1fcd_4ffd_9cfa_f2ebe577c085.slice/crio-6f34ba73a695e241a36a27b328d3035f58270f322cbd3f92077b89c7b9953882 WatchSource:0}: Error finding container 6f34ba73a695e241a36a27b328d3035f58270f322cbd3f92077b89c7b9953882: Status 404 returned error can't find the container with id 6f34ba73a695e241a36a27b328d3035f58270f322cbd3f92077b89c7b9953882 Jun 09 15:18:54.598563 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.598543 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:18:54.637388 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.637352 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hlqd" event={"ID":"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085","Type":"ContainerStarted","Data":"6f34ba73a695e241a36a27b328d3035f58270f322cbd3f92077b89c7b9953882"} Jun 09 15:18:54.638714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.638686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" event={"ID":"d8cd9214-292a-4834-a6da-9fa3071ffa35","Type":"ContainerStarted","Data":"50323784951da3b8d98fa053b9029dbd34d30c05885a4a808b6334a299e44531"} Jun 09 15:18:54.638869 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.638841 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:54.640445 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.640413 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="beab72f7e89a6e0a7ff9fb6950b961ab515b661fc315e38a15c376f602acffb3" exitCode=0 Jun 09 15:18:54.640554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.640441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"beab72f7e89a6e0a7ff9fb6950b961ab515b661fc315e38a15c376f602acffb3"} Jun 09 15:18:54.643770 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.643747 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" Jun 09 15:18:54.645683 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:18:54.645662 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6cf237_deb6_49cb_abfd_889ae9ecce52.slice/crio-d9f9b49bf7c16a53420dd4be77cccd498862364e5fbbdd876174375e99d4a2d5 WatchSource:0}: Error finding container d9f9b49bf7c16a53420dd4be77cccd498862364e5fbbdd876174375e99d4a2d5: Status 404 returned error can't find the container with id d9f9b49bf7c16a53420dd4be77cccd498862364e5fbbdd876174375e99d4a2d5 Jun 09 15:18:54.666942 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.666878 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r62gl" podStartSLOduration=3.130800432 podStartE2EDuration="4.666861875s" totalImagesPullingTime="1.536061443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:54.66577522 +0000 UTC m=+289.473534154" watchObservedRunningTime="2026-06-09 15:18:54.666861875 +0000 UTC m=+289.474620782" Jun 09 15:18:54.778688 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:54.778597 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:18:55.646329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:55.646293 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" event={"ID":"6a6cf237-deb6-49cb-abfd-889ae9ecce52","Type":"ContainerStarted","Data":"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae"} Jun 09 15:18:55.646780 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:55.646342 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" event={"ID":"6a6cf237-deb6-49cb-abfd-889ae9ecce52","Type":"ContainerStarted","Data":"d9f9b49bf7c16a53420dd4be77cccd498862364e5fbbdd876174375e99d4a2d5"} Jun 09 15:18:56.653976 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.653940 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hlqd" event={"ID":"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085","Type":"ContainerStarted","Data":"4387eebb18451020f7a1bc4aa139fc356cebc847104e2d64229e9ded93ce5ec4"} Jun 09 15:18:56.654361 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.654046 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hlqd" event={"ID":"89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085","Type":"ContainerStarted","Data":"25538e6620cc3dee49fc9f7a3bd2ecc5b72d3030e34bfa20c99d84813eb3b957"} Jun 09 15:18:56.654361 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.654215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:18:56.654361 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.654270 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:18:56.703969 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.703830 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" podStartSLOduration=290.703813001 podStartE2EDuration="4m50.703813001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:55.706330369 +0000 UTC m=+290.514089281" watchObservedRunningTime="2026-06-09 15:18:56.703813001 +0000 UTC m=+291.511571907" Jun 09 15:18:56.704232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.704207 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8hlqd" podStartSLOduration=250.83623831 podStartE2EDuration="4m12.704198891s" totalImagesPullingTime="1.867960581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:56.704181174 +0000 UTC m=+291.511940081" watchObservedRunningTime="2026-06-09 15:18:56.704198891 +0000 UTC m=+291.511957797" Jun 09 15:18:56.942054 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:56.942020 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:18:58.666771 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:58.666692 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"1252cb3699ae9460f363f9faeec86d85e4f21967eaefae7b2c2e49ac3e5478b8"} Jun 09 15:18:58.667179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:58.666782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"ef1e77ca53d410adb441513263f896e4387ad2c508b1ae049abdf51da9a7b338"} Jun 09 15:18:58.667179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:58.666819 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"3d4d559b3b6b75867ce39593ad40fb00592041769af3fe1fb9ee537f321979ed"} Jun 09 15:18:59.647620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:59.647593 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f769d897b-wlsc4" Jun 09 15:18:59.673416 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:59.673381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"010df543d67de4d5ad1278c974e4777ec6e67e05d017b35315a573d797dcdb69"} Jun 09 15:18:59.673745 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:59.673459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"44ff78201c6d20d03392058ee18c50b3a1b6ed16ca4cfe1ad99d71a8cd24e105"} Jun 09 15:18:59.673745 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:18:59.673499 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerStarted","Data":"09c08a3d11aa666dae8b05b1b0d342d666e2480bf5e60e53d088d125395f9673"} Jun 09 15:19:01.261106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:01.261056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:19:01.261106 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:01.261126 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:19:01.262474 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:01.262448 2566 patch_prober.go:28] interesting pod/console-67f668dc79-fndbn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 09 15:19:01.262597 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:01.262499 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f668dc79-fndbn" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 09 15:19:02.887566 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:02.887530 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:19:05.631503 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:05.631476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:19:05.632765 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:05.632738 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:19:05.635065 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:05.635047 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:19:05.681345 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:19:05.681191 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vdllv" podUID="99f90c41-2169-4223-839f-c576cc1a5b03" Jun 09 15:19:06.661405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:06.661369 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8hlqd" Jun 09 15:19:06.696391 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:06.696335 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.610258057 podStartE2EDuration="14.696319282s" totalImagesPullingTime="5.065435461s" totalInitContainerRuntime="20.625764ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:59.722503883 +0000 UTC m=+294.530262800" watchObservedRunningTime="2026-06-09 15:19:06.696319282 +0000 UTC m=+301.504078188" Jun 09 15:19:11.261896 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:11.261856 2566 patch_prober.go:28] interesting pod/console-67f668dc79-fndbn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 09 15:19:11.262315 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:11.261943 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f668dc79-fndbn" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 09 15:19:14.226279 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:14.226237 2566 patch_prober.go:28] interesting pod/image-registry-6758795dd6-p9q27 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:19:14.226640 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:14.226291 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:19:15.232858 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:15.232826 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:19:17.663538 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:17.663507 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:19:18.681137 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:18.681108 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:19:19.805767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:19.805706 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b94d9c7dd-gkdpr" podUID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" containerName="console" containerID="cri-o://5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b" gracePeriod=15 Jun 09 15:19:20.049307 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.049280 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:19:20.134594 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134499 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134594 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134554 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkwp9\" (UniqueName: \"kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134594 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134597 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134646 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134684 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134735 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.134876 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.134768 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca\") pod \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\" (UID: \"d7fec85a-8252-4a8b-8735-7514c4d8fd69\") " Jun 09 15:19:20.135165 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.135108 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config" (OuterVolumeSpecName: "console-config") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:20.135165 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.135140 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:20.135257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.135233 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:20.135362 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.135341 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:20.136964 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.136932 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:20.137074 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.136999 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9" (OuterVolumeSpecName: "kube-api-access-jkwp9") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "kube-api-access-jkwp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:20.137138 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.137094 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7fec85a-8252-4a8b-8735-7514c4d8fd69" (UID: "d7fec85a-8252-4a8b-8735-7514c4d8fd69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:20.235646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235611 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-serving-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235640 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-oauth-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235654 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-trusted-ca-bundle\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235668 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-service-ca\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235677 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-oauth-serving-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235684 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkwp9\" (UniqueName: \"kubernetes.io/projected/d7fec85a-8252-4a8b-8735-7514c4d8fd69-kube-api-access-jkwp9\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.235889 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.235693 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7fec85a-8252-4a8b-8735-7514c4d8fd69-console-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:20.751314 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.751284 2566 generic.go:356] "Generic (PLEG): container finished" podID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" containerID="5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b" exitCode=0 Jun 09 15:19:20.751459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.751328 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94d9c7dd-gkdpr" Jun 09 15:19:20.751459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.751368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94d9c7dd-gkdpr" event={"ID":"d7fec85a-8252-4a8b-8735-7514c4d8fd69","Type":"ContainerDied","Data":"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b"} Jun 09 15:19:20.751459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.751417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94d9c7dd-gkdpr" event={"ID":"d7fec85a-8252-4a8b-8735-7514c4d8fd69","Type":"ContainerDied","Data":"f6fae1cfb9f4de9bb6c6a87dc82bde98c3de214c96228da528e68daf6d4b583a"} Jun 09 15:19:20.752576 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.752563 2566 scope.go:117] "RemoveContainer" containerID="5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b" Jun 09 15:19:20.761419 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.761404 2566 scope.go:117] "RemoveContainer" containerID="5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b" Jun 09 15:19:20.761660 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:19:20.761641 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b\": container with ID starting with 5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b not found: ID does not exist" containerID="5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b" Jun 09 15:19:20.761710 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.761667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b"} err="failed to get container status \"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b\": rpc error: code = NotFound desc = could not find container \"5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b\": container with ID starting with 5125b07a2f49ccd0385e02c64e87f4434d9cc36de76d447895f2769a6246ca6b not found: ID does not exist" Jun 09 15:19:20.777539 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.777513 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:19:20.781006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:20.780980 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b94d9c7dd-gkdpr"] Jun 09 15:19:21.687838 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:21.687801 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" path="/var/lib/kubelet/pods/d7fec85a-8252-4a8b-8735-7514c4d8fd69/volumes" Jun 09 15:19:23.470823 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:23.470783 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:19:26.777537 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:26.777505 2566 generic.go:356] "Generic (PLEG): container finished" podID="edecabf9-9a38-4937-bd9a-977114fac2b3" containerID="ce6c33a14e9a2d7ef30c19751ccc7ca6720a5ddcd8e1c7f73f8bc79611306069" exitCode=0 Jun 09 15:19:26.777936 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:26.777566 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp6sc" event={"ID":"edecabf9-9a38-4937-bd9a-977114fac2b3","Type":"ContainerDied","Data":"ce6c33a14e9a2d7ef30c19751ccc7ca6720a5ddcd8e1c7f73f8bc79611306069"} Jun 09 15:19:26.777936 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:26.777880 2566 scope.go:117] "RemoveContainer" containerID="ce6c33a14e9a2d7ef30c19751ccc7ca6720a5ddcd8e1c7f73f8bc79611306069" Jun 09 15:19:27.762235 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:27.762202 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7rz4p_a4e1ca5f-73be-4031-aae2-238f6fc401b3/serve-healthcheck-canary/0.log" Jun 09 15:19:27.782864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:27.782831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp6sc" event={"ID":"edecabf9-9a38-4937-bd9a-977114fac2b3","Type":"ContainerStarted","Data":"e1aa8c4b16e9b8bc4299da553186d0bcbc178444f208aeb3ee61b78632205015"} Jun 09 15:19:28.155610 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:28.155583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-hwhzw_abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c/cluster-samples-operator/0.log" Jun 09 15:19:28.353837 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:28.353807 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-hwhzw_abfde49f-a8b3-4ea0-b095-d6ed6bfcd91c/cluster-samples-operator-watch/0.log" Jun 09 15:19:40.252418 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.252365 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67f668dc79-fndbn" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" containerID="cri-o://4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e" gracePeriod=15 Jun 09 15:19:40.548048 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.548021 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:19:40.618127 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618080 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618127 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618122 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618159 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfjlh\" (UniqueName: \"kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618222 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618258 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618310 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618405 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618348 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert\") pod \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\" (UID: \"027478c2-b0c9-4ea3-93c7-f11fa4f072ec\") " Jun 09 15:19:40.618672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618553 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:40.618672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618622 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config" (OuterVolumeSpecName: "console-config") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:40.618672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618632 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:40.618947 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.618898 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:40.620551 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.620510 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:40.620689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.620666 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh" (OuterVolumeSpecName: "kube-api-access-lfjlh") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "kube-api-access-lfjlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:40.620979 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.620951 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "027478c2-b0c9-4ea3-93c7-f11fa4f072ec" (UID: "027478c2-b0c9-4ea3-93c7-f11fa4f072ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:40.719411 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719381 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-oauth-serving-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719411 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719409 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719422 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-trusted-ca-bundle\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719436 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-serving-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719448 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-console-oauth-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719460 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-service-ca\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.719620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.719470 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfjlh\" (UniqueName: \"kubernetes.io/projected/027478c2-b0c9-4ea3-93c7-f11fa4f072ec-kube-api-access-lfjlh\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:40.840147 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.840040 2566 generic.go:356] "Generic (PLEG): container finished" podID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerID="4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e" exitCode=0 Jun 09 15:19:40.840329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.840161 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f668dc79-fndbn" event={"ID":"027478c2-b0c9-4ea3-93c7-f11fa4f072ec","Type":"ContainerDied","Data":"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e"} Jun 09 15:19:40.840329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.840214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f668dc79-fndbn" event={"ID":"027478c2-b0c9-4ea3-93c7-f11fa4f072ec","Type":"ContainerDied","Data":"1c51504a6fd6986d63ae87d88c71f7b5069a01d97e7ebd8374a3ebad20039af2"} Jun 09 15:19:40.840329 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.840245 2566 scope.go:117] "RemoveContainer" containerID="4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e" Jun 09 15:19:40.840502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.840419 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f668dc79-fndbn" Jun 09 15:19:40.852499 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.852480 2566 scope.go:117] "RemoveContainer" containerID="4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e" Jun 09 15:19:40.852791 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:19:40.852771 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e\": container with ID starting with 4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e not found: ID does not exist" containerID="4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e" Jun 09 15:19:40.852865 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.852805 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e"} err="failed to get container status \"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e\": rpc error: code = NotFound desc = could not find container \"4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e\": container with ID starting with 4fbfefad2307aab7e5ab0a158d027b4875cc18a8e281a4a5f6bc953d2789214e not found: ID does not exist" Jun 09 15:19:40.872321 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.872286 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:19:40.879316 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:40.879265 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f668dc79-fndbn"] Jun 09 15:19:41.685899 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:41.685866 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" path="/var/lib/kubelet/pods/027478c2-b0c9-4ea3-93c7-f11fa4f072ec/volumes" Jun 09 15:19:48.490768 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:48.490725 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerName="registry" containerID="cri-o://943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae" gracePeriod=30 Jun 09 15:19:49.741620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.741595 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:19:49.799378 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799348 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799402 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799432 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799455 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799487 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799761 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799651 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5tfj\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799761 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799707 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.799761 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799742 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") pod \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\" (UID: \"6a6cf237-deb6-49cb-abfd-889ae9ecce52\") " Jun 09 15:19:49.800277 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.799943 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:49.800277 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.800053 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-certificates\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.800481 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.800385 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:49.802458 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.802374 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:49.802458 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.802436 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj" (OuterVolumeSpecName: "kube-api-access-z5tfj") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "kube-api-access-z5tfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:49.802620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.802482 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:49.802620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.802530 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:49.802620 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.802532 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:49.808511 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.808491 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6a6cf237-deb6-49cb-abfd-889ae9ecce52" (UID: "6a6cf237-deb6-49cb-abfd-889ae9ecce52"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:19:49.876429 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.876391 2566 generic.go:356] "Generic (PLEG): container finished" podID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerID="943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae" exitCode=0 Jun 09 15:19:49.876593 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.876441 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" Jun 09 15:19:49.876593 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.876473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" event={"ID":"6a6cf237-deb6-49cb-abfd-889ae9ecce52","Type":"ContainerDied","Data":"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae"} Jun 09 15:19:49.876593 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.876528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6758795dd6-p9q27" event={"ID":"6a6cf237-deb6-49cb-abfd-889ae9ecce52","Type":"ContainerDied","Data":"d9f9b49bf7c16a53420dd4be77cccd498862364e5fbbdd876174375e99d4a2d5"} Jun 09 15:19:49.876593 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.876547 2566 scope.go:117] "RemoveContainer" containerID="943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae" Jun 09 15:19:49.884955 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.884936 2566 scope.go:117] "RemoveContainer" containerID="943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae" Jun 09 15:19:49.885217 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:19:49.885199 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae\": container with ID starting with 943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae not found: ID does not exist" containerID="943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae" Jun 09 15:19:49.885255 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.885227 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae"} err="failed to get container status \"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae\": rpc error: code = NotFound desc = could not find container \"943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae\": container with ID starting with 943584d374b7e76f91ea3b5e253d9a9c371c03de39e7aa765731a7b7127a27ae not found: ID does not exist" Jun 09 15:19:49.901347 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901320 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-image-registry-private-configuration\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901347 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901343 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-bound-sa-token\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901353 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a6cf237-deb6-49cb-abfd-889ae9ecce52-installation-pull-secrets\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901362 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5tfj\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-kube-api-access-z5tfj\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901370 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cf237-deb6-49cb-abfd-889ae9ecce52-trusted-ca\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901378 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a6cf237-deb6-49cb-abfd-889ae9ecce52-registry-tls\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.901478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.901386 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a6cf237-deb6-49cb-abfd-889ae9ecce52-ca-trust-extracted\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:19:49.911533 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.911504 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:19:49.919749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:49.919724 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6758795dd6-p9q27"] Jun 09 15:19:51.685532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:51.685501 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" path="/var/lib/kubelet/pods/6a6cf237-deb6-49cb-abfd-889ae9ecce52/volumes" Jun 09 15:19:52.886840 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:52.886812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:19:52.907558 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:52.907530 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:19:53.907589 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:19:53.907563 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:10.790655 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790621 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790938 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="prometheus" containerID="cri-o://3d4d559b3b6b75867ce39593ad40fb00592041769af3fe1fb9ee537f321979ed" gracePeriod=600 Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790976 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="thanos-sidecar" containerID="cri-o://1252cb3699ae9460f363f9faeec86d85e4f21967eaefae7b2c2e49ac3e5478b8" gracePeriod=600 Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790999 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="config-reloader" containerID="cri-o://ef1e77ca53d410adb441513263f896e4387ad2c508b1ae049abdf51da9a7b338" gracePeriod=600 Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.791031 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-thanos" containerID="cri-o://010df543d67de4d5ad1278c974e4777ec6e67e05d017b35315a573d797dcdb69" gracePeriod=600 Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790976 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy" containerID="cri-o://44ff78201c6d20d03392058ee18c50b3a1b6ed16ca4cfe1ad99d71a8cd24e105" gracePeriod=600 Jun 09 15:20:10.791157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.790994 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-web" containerID="cri-o://09c08a3d11aa666dae8b05b1b0d342d666e2480bf5e60e53d088d125395f9673" gracePeriod=600 Jun 09 15:20:10.957712 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957673 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="010df543d67de4d5ad1278c974e4777ec6e67e05d017b35315a573d797dcdb69" exitCode=0 Jun 09 15:20:10.957712 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957705 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="44ff78201c6d20d03392058ee18c50b3a1b6ed16ca4cfe1ad99d71a8cd24e105" exitCode=0 Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957719 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="09c08a3d11aa666dae8b05b1b0d342d666e2480bf5e60e53d088d125395f9673" exitCode=0 Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957728 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="1252cb3699ae9460f363f9faeec86d85e4f21967eaefae7b2c2e49ac3e5478b8" exitCode=0 Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"010df543d67de4d5ad1278c974e4777ec6e67e05d017b35315a573d797dcdb69"} Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"44ff78201c6d20d03392058ee18c50b3a1b6ed16ca4cfe1ad99d71a8cd24e105"} Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957739 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="ef1e77ca53d410adb441513263f896e4387ad2c508b1ae049abdf51da9a7b338" exitCode=0 Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"09c08a3d11aa666dae8b05b1b0d342d666e2480bf5e60e53d088d125395f9673"} Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957830 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5d79623-1f76-4523-af54-74b054560408" containerID="3d4d559b3b6b75867ce39593ad40fb00592041769af3fe1fb9ee537f321979ed" exitCode=0 Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"1252cb3699ae9460f363f9faeec86d85e4f21967eaefae7b2c2e49ac3e5478b8"} Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957876 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"ef1e77ca53d410adb441513263f896e4387ad2c508b1ae049abdf51da9a7b338"} Jun 09 15:20:10.957900 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:10.957899 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"3d4d559b3b6b75867ce39593ad40fb00592041769af3fe1fb9ee537f321979ed"} Jun 09 15:20:11.038176 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.038147 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:11.179426 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179390 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179426 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179432 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179465 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179499 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179522 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179550 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpd6z\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179580 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179606 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179639 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179663 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.179701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179703 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179731 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179758 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179780 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179806 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179835 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179841 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179869 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.179954 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180003 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180034 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f5d79623-1f76-4523-af54-74b054560408\" (UID: \"f5d79623-1f76-4523-af54-74b054560408\") " Jun 09 15:20:11.180672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180242 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.180672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180304 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.180672 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180598 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.180821 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.180665 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:20:11.181615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.181014 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.181615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.181352 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.182030 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.182001 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.182502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.182484 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.182969 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.182949 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config" (OuterVolumeSpecName: "config") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.183068 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.183029 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.183294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.183269 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:11.183815 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.183703 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z" (OuterVolumeSpecName: "kube-api-access-wpd6z") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "kube-api-access-wpd6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:20:11.183815 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.183767 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out" (OuterVolumeSpecName: "config-out") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:20:11.184040 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.184006 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.184337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.184316 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.184590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.184572 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:20:11.184970 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.184941 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.185258 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.185233 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.185521 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.185501 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.192784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.192762 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config" (OuterVolumeSpecName: "web-config") pod "f5d79623-1f76-4523-af54-74b054560408" (UID: "f5d79623-1f76-4523-af54-74b054560408"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:11.281374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281333 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-grpc-tls\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281363 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-web-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281372 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-kube-rbac-proxy\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281382 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpd6z\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-kube-api-access-wpd6z\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281390 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281398 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281407 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281416 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281424 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-config\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281434 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-config-out\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281442 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d79623-1f76-4523-af54-74b054560408-tls-assets\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281451 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281459 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281467 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281475 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281484 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-metrics-client-certs\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281494 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d79623-1f76-4523-af54-74b054560408-configmap-metrics-client-ca\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281502 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5d79623-1f76-4523-af54-74b054560408-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.281714 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.281511 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d79623-1f76-4523-af54-74b054560408-prometheus-k8s-db\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:20:11.965786 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.965702 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5d79623-1f76-4523-af54-74b054560408","Type":"ContainerDied","Data":"d391dd078616f9234c68f7508c222d1f213fe6a634b870c568ac613ce7a1af29"} Jun 09 15:20:11.965786 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.965782 2566 scope.go:117] "RemoveContainer" containerID="010df543d67de4d5ad1278c974e4777ec6e67e05d017b35315a573d797dcdb69" Jun 09 15:20:11.965786 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.965784 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:11.974046 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.974026 2566 scope.go:117] "RemoveContainer" containerID="44ff78201c6d20d03392058ee18c50b3a1b6ed16ca4cfe1ad99d71a8cd24e105" Jun 09 15:20:11.981058 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.981037 2566 scope.go:117] "RemoveContainer" containerID="09c08a3d11aa666dae8b05b1b0d342d666e2480bf5e60e53d088d125395f9673" Jun 09 15:20:11.987627 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.987608 2566 scope.go:117] "RemoveContainer" containerID="1252cb3699ae9460f363f9faeec86d85e4f21967eaefae7b2c2e49ac3e5478b8" Jun 09 15:20:11.992754 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.992732 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:11.994495 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.994482 2566 scope.go:117] "RemoveContainer" containerID="ef1e77ca53d410adb441513263f896e4387ad2c508b1ae049abdf51da9a7b338" Jun 09 15:20:11.999179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:11.999158 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:12.001446 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.001431 2566 scope.go:117] "RemoveContainer" containerID="3d4d559b3b6b75867ce39593ad40fb00592041769af3fe1fb9ee537f321979ed" Jun 09 15:20:12.008722 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.008702 2566 scope.go:117] "RemoveContainer" containerID="beab72f7e89a6e0a7ff9fb6950b961ab515b661fc315e38a15c376f602acffb3" Jun 09 15:20:12.029511 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029487 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:12.029763 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029751 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029764 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029773 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029779 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029785 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-thanos" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029790 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-thanos" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029798 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="prometheus" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029803 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="prometheus" Jun 09 15:20:12.029808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029809 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerName="registry" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029816 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerName="registry" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029822 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-web" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029827 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-web" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029842 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="init-config-reloader" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029847 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="init-config-reloader" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029854 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="config-reloader" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029859 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="config-reloader" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029865 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="thanos-sidecar" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029870 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="thanos-sidecar" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029877 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" containerName="console" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029882 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" containerName="console" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029943 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029950 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-web" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029957 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="thanos-sidecar" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029963 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6cf237-deb6-49cb-abfd-889ae9ecce52" containerName="registry" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029968 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="prometheus" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029973 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="config-reloader" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029978 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d79623-1f76-4523-af54-74b054560408" containerName="kube-rbac-proxy-thanos" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029983 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7fec85a-8252-4a8b-8735-7514c4d8fd69" containerName="console" Jun 09 15:20:12.030087 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.029989 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="027478c2-b0c9-4ea3-93c7-f11fa4f072ec" containerName="console" Jun 09 15:20:12.035160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.035144 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.038123 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038094 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 15:20:12.038231 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038173 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 15:20:12.038231 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 15:20:12.038231 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 15:20:12.038531 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038515 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 15:20:12.038605 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038542 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:20:12.038722 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 15:20:12.038774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038709 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 15:20:12.038774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038709 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 15:20:12.038971 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.038955 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 15:20:12.039058 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.039006 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4mvqtvhaqirlh\"" Jun 09 15:20:12.039111 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.039065 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 15:20:12.039384 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.039368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 15:20:12.039677 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.039659 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwrps\"" Jun 09 15:20:12.039677 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.039671 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 15:20:12.042674 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.042615 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 15:20:12.046325 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.046305 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 15:20:12.053251 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.053229 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:12.188787 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.188787 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.188998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bws8l\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-kube-api-access-bws8l\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.189275 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.189275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290139 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bws8l\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-kube-api-access-bws8l\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290459 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290660 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290729 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290729 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290839 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290839 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290779 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290839 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.290839 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.290985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.291017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291089 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.291053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291385 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.291167 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291593 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.291508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.291693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.291679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.292061 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.292039 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.292327 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.292305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.293198 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.292801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.293436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.293441 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.293563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.293928 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.294432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.294784 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.294716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.295505 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.295354 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.295594 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.295520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.295594 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.295543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.295703 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.295664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a15d58-d1f7-4236-90be-057acff96b17-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.296122 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.296097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.296656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.296635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a15d58-d1f7-4236-90be-057acff96b17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.297042 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.297025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a15d58-d1f7-4236-90be-057acff96b17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.299657 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.299636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bws8l\" (UniqueName: \"kubernetes.io/projected/37a15d58-d1f7-4236-90be-057acff96b17-kube-api-access-bws8l\") pod \"prometheus-k8s-0\" (UID: \"37a15d58-d1f7-4236-90be-057acff96b17\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.345552 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.345510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:12.488548 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.488514 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:20:12.491784 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:20:12.491753 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a15d58_d1f7_4236_90be_057acff96b17.slice/crio-d9d27e7f2ea232e4a26a4aca868a8e5362d7cfdef1bf7da250140e663281396f WatchSource:0}: Error finding container d9d27e7f2ea232e4a26a4aca868a8e5362d7cfdef1bf7da250140e663281396f: Status 404 returned error can't find the container with id d9d27e7f2ea232e4a26a4aca868a8e5362d7cfdef1bf7da250140e663281396f Jun 09 15:20:12.971834 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.971802 2566 generic.go:356] "Generic (PLEG): container finished" podID="37a15d58-d1f7-4236-90be-057acff96b17" containerID="9d6e72a8a6b6c2cd3987476eb52d8918609f047fd82aa319756f315bc82cd8d9" exitCode=0 Jun 09 15:20:12.972232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.971861 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerDied","Data":"9d6e72a8a6b6c2cd3987476eb52d8918609f047fd82aa319756f315bc82cd8d9"} Jun 09 15:20:12.972232 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:12.971931 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"d9d27e7f2ea232e4a26a4aca868a8e5362d7cfdef1bf7da250140e663281396f"} Jun 09 15:20:13.685532 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.685499 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d79623-1f76-4523-af54-74b054560408" path="/var/lib/kubelet/pods/f5d79623-1f76-4523-af54-74b054560408/volumes" Jun 09 15:20:13.983200 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"f70fa6e698d18812dab2e0abf4d4d5440a87f2c2046ac815eb09a088f6b51665"} Jun 09 15:20:13.983571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"365ac8f9fded540c0adb872618dab4903bb658f5449a6a5307327cb7ec71e2c7"} Jun 09 15:20:13.983571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"05bab737a62bc343bddd19a0fc1a94746df6f08bc7ebd310e0aaffae35f823e9"} Jun 09 15:20:13.983571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"70c96c3eb846c920f4bd4c45bcdc51bd920e9bdc70736b9eb090174d2e9412c2"} Jun 09 15:20:13.983571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983342 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"3f3089fc33c59708dee76195816c267743597ed4d1e3fc2b1295087bd60c087d"} Jun 09 15:20:13.983571 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:13.983384 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a15d58-d1f7-4236-90be-057acff96b17","Type":"ContainerStarted","Data":"685e5360e3d2751d2346100ce2d5336ab83fbe5b9a88bd39bd7299740c30a248"} Jun 09 15:20:14.018379 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:14.018318 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.998268395 podStartE2EDuration="2.018301361s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.032966ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:14.016134134 +0000 UTC m=+368.823893076" watchObservedRunningTime="2026-06-09 15:20:14.018301361 +0000 UTC m=+368.826060268" Jun 09 15:20:17.345971 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:17.345928 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:20:19.756416 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:19.756374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:20:19.758755 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:19.758729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f90c41-2169-4223-839f-c576cc1a5b03-metrics-certs\") pod \"network-metrics-daemon-vdllv\" (UID: \"99f90c41-2169-4223-839f-c576cc1a5b03\") " pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:20:19.884926 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:19.884879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:20:19.892374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:19.892350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdllv" Jun 09 15:20:20.022206 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:20.022136 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdllv"] Jun 09 15:20:20.024995 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:20:20.024968 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f90c41_2169_4223_839f_c576cc1a5b03.slice/crio-59e7c5ae6fda5a623b8d999538847c56c332497df68ed33a831cb59bb9a94797 WatchSource:0}: Error finding container 59e7c5ae6fda5a623b8d999538847c56c332497df68ed33a831cb59bb9a94797: Status 404 returned error can't find the container with id 59e7c5ae6fda5a623b8d999538847c56c332497df68ed33a831cb59bb9a94797 Jun 09 15:20:20.027205 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:20.027187 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:20:21.011052 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:21.011009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdllv" event={"ID":"99f90c41-2169-4223-839f-c576cc1a5b03","Type":"ContainerStarted","Data":"59e7c5ae6fda5a623b8d999538847c56c332497df68ed33a831cb59bb9a94797"} Jun 09 15:20:22.016082 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:22.016042 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdllv" event={"ID":"99f90c41-2169-4223-839f-c576cc1a5b03","Type":"ContainerStarted","Data":"3774f6e648cd14c6e40da9c842e5a93b0d9f56b2c9e33fc31f4371545147aab7"} Jun 09 15:20:22.016554 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:22.016094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdllv" event={"ID":"99f90c41-2169-4223-839f-c576cc1a5b03","Type":"ContainerStarted","Data":"4bd586360523ba0c80aacf413a796204bc75bae2b445ffd6b5fac8eafa49f5f4"} Jun 09 15:20:22.034925 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:20:22.034858 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdllv" podStartSLOduration=375.096525054 podStartE2EDuration="6m16.03484211s" totalImagesPullingTime="938.317056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:22.033212276 +0000 UTC m=+376.840971184" watchObservedRunningTime="2026-06-09 15:20:22.03484211 +0000 UTC m=+376.842601017" Jun 09 15:21:12.346744 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:21:12.346691 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:21:12.362291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:21:12.362263 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:21:13.230352 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:21:13.230325 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:22:50.494628 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.494589 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8"] Jun 09 15:22:50.497767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.497749 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.500849 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.500829 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:22:50.501182 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.501167 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7jrbn\"" Jun 09 15:22:50.502124 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.502110 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:22:50.515058 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.515031 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8"] Jun 09 15:22:50.581181 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.581146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2rw\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-kube-api-access-wk2rw\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.581377 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.581260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.681776 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.681739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2rw\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-kube-api-access-wk2rw\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.682002 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.681803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.691740 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.691714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.691883 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.691855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2rw\" (UniqueName: \"kubernetes.io/projected/65363a15-1434-4145-875e-07e78ae50a0b-kube-api-access-wk2rw\") pod \"cert-manager-cainjector-5d99449ffd-mm4p8\" (UID: \"65363a15-1434-4145-875e-07e78ae50a0b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.821699 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.821606 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" Jun 09 15:22:50.955498 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:50.955464 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8"] Jun 09 15:22:50.958507 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:22:50.958470 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65363a15_1434_4145_875e_07e78ae50a0b.slice/crio-618f7194f3b9699cb4606ca008e53eb2b93416d207777e03ddcd2f4040c7a82b WatchSource:0}: Error finding container 618f7194f3b9699cb4606ca008e53eb2b93416d207777e03ddcd2f4040c7a82b: Status 404 returned error can't find the container with id 618f7194f3b9699cb4606ca008e53eb2b93416d207777e03ddcd2f4040c7a82b Jun 09 15:22:51.580548 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:51.580502 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" event={"ID":"65363a15-1434-4145-875e-07e78ae50a0b","Type":"ContainerStarted","Data":"618f7194f3b9699cb4606ca008e53eb2b93416d207777e03ddcd2f4040c7a82b"} Jun 09 15:22:54.595155 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:54.595108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" event={"ID":"65363a15-1434-4145-875e-07e78ae50a0b","Type":"ContainerStarted","Data":"b5823f2114b886925e0be62a408cb7951799c2db1f67206441cff250eb80e0c6"} Jun 09 15:22:54.613925 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:22:54.613854 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mm4p8" podStartSLOduration=2.002142278 podStartE2EDuration="4.613837829s" totalImagesPullingTime="2.611695551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:22:54.612841899 +0000 UTC m=+529.420600824" watchObservedRunningTime="2026-06-09 15:22:54.613837829 +0000 UTC m=+529.421596737" Jun 09 15:23:21.924757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.924725 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb"] Jun 09 15:23:21.928018 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.927998 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.930790 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.930767 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:23:21.931072 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.931053 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:23:21.931297 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.931280 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:23:21.931363 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.931336 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d92l8\"" Jun 09 15:23:21.931499 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.931483 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:23:21.944076 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.944048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.944188 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.944086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.944188 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.944107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42r6\" (UniqueName: \"kubernetes.io/projected/73f4700e-dae7-48d5-aa8b-d3511ab10209-kube-api-access-t42r6\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.944188 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.944158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.944295 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.944215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:21.949632 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:21.949609 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb"] Jun 09 15:23:22.044970 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.044899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.045172 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.044992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.045172 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.045021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42r6\" (UniqueName: \"kubernetes.io/projected/73f4700e-dae7-48d5-aa8b-d3511ab10209-kube-api-access-t42r6\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.045172 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.045038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.045172 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.045077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.045375 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.045284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.047440 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.047407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73f4700e-dae7-48d5-aa8b-d3511ab10209-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.047619 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.047596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.047660 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.047610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73f4700e-dae7-48d5-aa8b-d3511ab10209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.053738 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.053713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42r6\" (UniqueName: \"kubernetes.io/projected/73f4700e-dae7-48d5-aa8b-d3511ab10209-kube-api-access-t42r6\") pod \"opendatahub-operator-controller-manager-f5f495f5c-ftfvb\" (UID: \"73f4700e-dae7-48d5-aa8b-d3511ab10209\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.239647 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.239540 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:22.406510 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.406477 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb"] Jun 09 15:23:22.411305 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:23:22.411279 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f4700e_dae7_48d5_aa8b_d3511ab10209.slice/crio-0c96f703967d0367abfca0734407f768d37d03387447dc188feb9e29be7f3fe3 WatchSource:0}: Error finding container 0c96f703967d0367abfca0734407f768d37d03387447dc188feb9e29be7f3fe3: Status 404 returned error can't find the container with id 0c96f703967d0367abfca0734407f768d37d03387447dc188feb9e29be7f3fe3 Jun 09 15:23:22.702848 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:22.702805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" event={"ID":"73f4700e-dae7-48d5-aa8b-d3511ab10209","Type":"ContainerStarted","Data":"0c96f703967d0367abfca0734407f768d37d03387447dc188feb9e29be7f3fe3"} Jun 09 15:23:25.719369 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:25.719330 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" event={"ID":"73f4700e-dae7-48d5-aa8b-d3511ab10209","Type":"ContainerStarted","Data":"64b33f0fb16b310f8e0da91f7e709ae8f97abc9050ad3d2e586a16fa7c9e82a4"} Jun 09 15:23:26.724285 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:26.724254 2566 generic.go:356] "Generic (PLEG): container finished" podID="73f4700e-dae7-48d5-aa8b-d3511ab10209" containerID="64b33f0fb16b310f8e0da91f7e709ae8f97abc9050ad3d2e586a16fa7c9e82a4" exitCode=0 Jun 09 15:23:26.724671 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:26.724339 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" event={"ID":"73f4700e-dae7-48d5-aa8b-d3511ab10209","Type":"ContainerDied","Data":"64b33f0fb16b310f8e0da91f7e709ae8f97abc9050ad3d2e586a16fa7c9e82a4"} Jun 09 15:23:27.732346 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:27.732308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" event={"ID":"73f4700e-dae7-48d5-aa8b-d3511ab10209","Type":"ContainerStarted","Data":"f03623b87f956fcfe0da0ec42bbbde06303c7468fe030596d74f5deaebab7bcb"} Jun 09 15:23:27.732829 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:27.732399 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:27.753306 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:27.753259 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" podStartSLOduration=2.516888978 podStartE2EDuration="6.753242057s" totalImagesPullingTime="3.28228141s" totalInitContainerRuntime="954.071669ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:27.753218776 +0000 UTC m=+562.560977673" watchObservedRunningTime="2026-06-09 15:23:27.753242057 +0000 UTC m=+562.561000942" Jun 09 15:23:38.739340 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:38.739302 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-ftfvb" Jun 09 15:23:49.266864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.266826 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv"] Jun 09 15:23:49.270112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.270095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.273355 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.273330 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 15:23:49.274504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.274483 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 15:23:49.274634 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.274510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 15:23:49.274634 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.274485 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:23:49.274634 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.274487 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 15:23:49.274634 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.274557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-swczv\"" Jun 09 15:23:49.280523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.280500 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv"] Jun 09 15:23:49.411021 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.410988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.411021 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.411025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-metrics-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.411248 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.411092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/928d7eb1-ab12-4537-ab32-c035dea5cb7a-manager-config\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.411248 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.411111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jx56\" (UniqueName: \"kubernetes.io/projected/928d7eb1-ab12-4537-ab32-c035dea5cb7a-kube-api-access-4jx56\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.512322 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.512290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/928d7eb1-ab12-4537-ab32-c035dea5cb7a-manager-config\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.512322 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.512326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jx56\" (UniqueName: \"kubernetes.io/projected/928d7eb1-ab12-4537-ab32-c035dea5cb7a-kube-api-access-4jx56\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.512527 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.512373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.512527 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.512392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-metrics-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.513118 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.513097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/928d7eb1-ab12-4537-ab32-c035dea5cb7a-manager-config\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.514928 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.514894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.515010 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.514991 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/928d7eb1-ab12-4537-ab32-c035dea5cb7a-metrics-cert\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.522654 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.522592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jx56\" (UniqueName: \"kubernetes.io/projected/928d7eb1-ab12-4537-ab32-c035dea5cb7a-kube-api-access-4jx56\") pod \"lws-controller-manager-565556b8fb-5vggv\" (UID: \"928d7eb1-ab12-4537-ab32-c035dea5cb7a\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.579747 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.579707 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:49.747304 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.747264 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv"] Jun 09 15:23:49.750113 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:23:49.750090 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928d7eb1_ab12_4537_ab32_c035dea5cb7a.slice/crio-a757b9aa55d66b62869e7c9d13d216ba558c76a983ad3f869b368c6b975a4109 WatchSource:0}: Error finding container a757b9aa55d66b62869e7c9d13d216ba558c76a983ad3f869b368c6b975a4109: Status 404 returned error can't find the container with id a757b9aa55d66b62869e7c9d13d216ba558c76a983ad3f869b368c6b975a4109 Jun 09 15:23:49.822374 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:49.822284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" event={"ID":"928d7eb1-ab12-4537-ab32-c035dea5cb7a","Type":"ContainerStarted","Data":"a757b9aa55d66b62869e7c9d13d216ba558c76a983ad3f869b368c6b975a4109"} Jun 09 15:23:52.840108 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:52.840072 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" event={"ID":"928d7eb1-ab12-4537-ab32-c035dea5cb7a","Type":"ContainerStarted","Data":"2f40167bb50c661e2097d74663eb8d22ee21f35882bb292ee36828520ab1a422"} Jun 09 15:23:52.840504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:52.840148 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:23:52.860697 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:23:52.860642 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" podStartSLOduration=1.288927808 podStartE2EDuration="3.860624767s" totalImagesPullingTime="2.571696959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:52.859721791 +0000 UTC m=+587.667480774" watchObservedRunningTime="2026-06-09 15:23:52.860624767 +0000 UTC m=+587.668383675" Jun 09 15:24:02.604930 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.604872 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-mhscj"] Jun 09 15:24:02.617472 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.617439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.618957 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.618921 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-mhscj"] Jun 09 15:24:02.620427 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.620398 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 15:24:02.620427 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.620420 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qvvtf\"" Jun 09 15:24:02.727141 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.727109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/df7ac7a7-1207-4d3f-b01c-8a225478173a-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.727301 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.727163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzl5g\" (UniqueName: \"kubernetes.io/projected/df7ac7a7-1207-4d3f-b01c-8a225478173a-kube-api-access-rzl5g\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.828462 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.828429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/df7ac7a7-1207-4d3f-b01c-8a225478173a-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.828618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.828481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzl5g\" (UniqueName: \"kubernetes.io/projected/df7ac7a7-1207-4d3f-b01c-8a225478173a-kube-api-access-rzl5g\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.829204 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.829184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/df7ac7a7-1207-4d3f-b01c-8a225478173a-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.837095 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.837071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzl5g\" (UniqueName: \"kubernetes.io/projected/df7ac7a7-1207-4d3f-b01c-8a225478173a-kube-api-access-rzl5g\") pod \"dashboard-redirect-6dc9d488bd-mhscj\" (UID: \"df7ac7a7-1207-4d3f-b01c-8a225478173a\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:02.927933 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:02.927865 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" Jun 09 15:24:03.079378 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:03.079342 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-mhscj"] Jun 09 15:24:03.082633 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:24:03.082607 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7ac7a7_1207_4d3f_b01c_8a225478173a.slice/crio-8746468ed536f6060bf5fe417e75c8f9bc78fdf1c1944dcd6d3cc8b1d2e0ed59 WatchSource:0}: Error finding container 8746468ed536f6060bf5fe417e75c8f9bc78fdf1c1944dcd6d3cc8b1d2e0ed59: Status 404 returned error can't find the container with id 8746468ed536f6060bf5fe417e75c8f9bc78fdf1c1944dcd6d3cc8b1d2e0ed59 Jun 09 15:24:03.846815 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:03.846784 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-5vggv" Jun 09 15:24:03.887801 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:03.887770 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" event={"ID":"df7ac7a7-1207-4d3f-b01c-8a225478173a","Type":"ContainerStarted","Data":"8746468ed536f6060bf5fe417e75c8f9bc78fdf1c1944dcd6d3cc8b1d2e0ed59"} Jun 09 15:24:05.664520 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:05.664496 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:24:05.664976 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:05.664954 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:24:05.899153 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:05.899109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" event={"ID":"df7ac7a7-1207-4d3f-b01c-8a225478173a","Type":"ContainerStarted","Data":"b6e97884f438835105395e94357b0c8777438f153aace0a4926321970748b3ba"} Jun 09 15:24:05.916391 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:05.916338 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6dc9d488bd-mhscj" podStartSLOduration=1.420737781 podStartE2EDuration="3.916321384s" totalImagesPullingTime="2.495583603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:05.915319019 +0000 UTC m=+600.723077928" watchObservedRunningTime="2026-06-09 15:24:05.916321384 +0000 UTC m=+600.724080290" Jun 09 15:24:19.935969 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.935868 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9"] Jun 09 15:24:19.939715 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.939694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:19.942464 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.942440 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5tlpp\"" Jun 09 15:24:19.942617 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.942468 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 15:24:19.942617 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.942500 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:24:19.942750 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.942730 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:24:19.951279 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:19.951252 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9"] Jun 09 15:24:20.080812 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.080774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.080812 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.080829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081073 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.080853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081073 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081143 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081143 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081219 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnhfn\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-kube-api-access-fnhfn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081219 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.081219 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.081209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182733 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182861 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnhfn\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-kube-api-access-fnhfn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182861 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.182861 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182806 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.183043 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.182948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.183142 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.183120 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.183340 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.183316 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.184864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.184843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.185085 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.185063 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.190214 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.190156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.190291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.190250 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnhfn\" (UniqueName: \"kubernetes.io/projected/9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc-kube-api-access-fnhfn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mq6n9\" (UID: \"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.252047 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.252011 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:20.391599 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.391573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9"] Jun 09 15:24:20.393855 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:24:20.393824 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2ffbcb_f6e1_4d32_9a15_9be1bb5317cc.slice/crio-3a40dc3908f24a7e1dfd49532a4d54b7435bf432eda66b1c403e10eaa4700b16 WatchSource:0}: Error finding container 3a40dc3908f24a7e1dfd49532a4d54b7435bf432eda66b1c403e10eaa4700b16: Status 404 returned error can't find the container with id 3a40dc3908f24a7e1dfd49532a4d54b7435bf432eda66b1c403e10eaa4700b16 Jun 09 15:24:20.963699 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:20.963666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" event={"ID":"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc","Type":"ContainerStarted","Data":"3a40dc3908f24a7e1dfd49532a4d54b7435bf432eda66b1c403e10eaa4700b16"} Jun 09 15:24:23.578170 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:23.578110 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:24:23.578485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:23.578188 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:24:23.578485 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:23.578220 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:24:23.979337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:23.979301 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" event={"ID":"9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc","Type":"ContainerStarted","Data":"f3cbc2bcf1fd7f4ed728f10a0bc87ff0a2f20a2ac8affb095a9ab83f0b5ee4a8"} Jun 09 15:24:24.001644 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:24.001596 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" podStartSLOduration=1.819850727 podStartE2EDuration="5.00157932s" totalImagesPullingTime="3.181728593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:24.000450586 +0000 UTC m=+618.808209509" watchObservedRunningTime="2026-06-09 15:24:24.00157932 +0000 UTC m=+618.809338221" Jun 09 15:24:24.252506 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:24.252413 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:24.257228 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:24.257201 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:24.984086 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:24.984055 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:24.985052 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:24.985033 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mq6n9" Jun 09 15:24:42.066337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.066303 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:42.081327 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.081287 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:42.081508 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.081398 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:42.084318 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.084294 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sdhg8\"" Jun 09 15:24:42.084567 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.084552 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:24:42.085550 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.085534 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:24:42.176773 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.176736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zh4\" (UniqueName: \"kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4\") pod \"kuadrant-operator-catalog-8kgqh\" (UID: \"b3372308-26cf-4b7e-94f1-0ddb8fca306d\") " pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:42.277769 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.277733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zh4\" (UniqueName: \"kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4\") pod \"kuadrant-operator-catalog-8kgqh\" (UID: \"b3372308-26cf-4b7e-94f1-0ddb8fca306d\") " pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:42.285969 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.285930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zh4\" (UniqueName: \"kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4\") pod \"kuadrant-operator-catalog-8kgqh\" (UID: \"b3372308-26cf-4b7e-94f1-0ddb8fca306d\") " pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:42.392079 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.392045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:42.427629 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.427593 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:42.523290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.523265 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:42.525571 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:24:42.525540 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3372308_26cf_4b7e_94f1_0ddb8fca306d.slice/crio-a42ef2326e4c1edfbc22db5d6d66d447ab0c69d7e9c14d4ad99ee206a628b732 WatchSource:0}: Error finding container a42ef2326e4c1edfbc22db5d6d66d447ab0c69d7e9c14d4ad99ee206a628b732: Status 404 returned error can't find the container with id a42ef2326e4c1edfbc22db5d6d66d447ab0c69d7e9c14d4ad99ee206a628b732 Jun 09 15:24:42.638224 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.638186 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zw2df"] Jun 09 15:24:42.643046 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.642986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:42.650649 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.650623 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zw2df"] Jun 09 15:24:42.782685 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.782627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvppv\" (UniqueName: \"kubernetes.io/projected/9c2daf54-1805-4c65-b15a-88c5dcf00dc9-kube-api-access-mvppv\") pod \"kuadrant-operator-catalog-zw2df\" (UID: \"9c2daf54-1805-4c65-b15a-88c5dcf00dc9\") " pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:42.883751 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.883715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvppv\" (UniqueName: \"kubernetes.io/projected/9c2daf54-1805-4c65-b15a-88c5dcf00dc9-kube-api-access-mvppv\") pod \"kuadrant-operator-catalog-zw2df\" (UID: \"9c2daf54-1805-4c65-b15a-88c5dcf00dc9\") " pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:42.893567 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.893509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvppv\" (UniqueName: \"kubernetes.io/projected/9c2daf54-1805-4c65-b15a-88c5dcf00dc9-kube-api-access-mvppv\") pod \"kuadrant-operator-catalog-zw2df\" (UID: \"9c2daf54-1805-4c65-b15a-88c5dcf00dc9\") " pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:42.952556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:42.952518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:43.062099 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:43.062034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" event={"ID":"b3372308-26cf-4b7e-94f1-0ddb8fca306d","Type":"ContainerStarted","Data":"a42ef2326e4c1edfbc22db5d6d66d447ab0c69d7e9c14d4ad99ee206a628b732"} Jun 09 15:24:43.084723 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:43.084673 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zw2df"] Jun 09 15:24:43.088921 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:24:43.088885 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2daf54_1805_4c65_b15a_88c5dcf00dc9.slice/crio-4aa96239d0589b9cfddb9fdd259a3a3e7c92e02675e1ac597c6e1b470acd1b7a WatchSource:0}: Error finding container 4aa96239d0589b9cfddb9fdd259a3a3e7c92e02675e1ac597c6e1b470acd1b7a: Status 404 returned error can't find the container with id 4aa96239d0589b9cfddb9fdd259a3a3e7c92e02675e1ac597c6e1b470acd1b7a Jun 09 15:24:44.067496 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:44.067453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" event={"ID":"9c2daf54-1805-4c65-b15a-88c5dcf00dc9","Type":"ContainerStarted","Data":"4aa96239d0589b9cfddb9fdd259a3a3e7c92e02675e1ac597c6e1b470acd1b7a"} Jun 09 15:24:45.073886 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.073848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" event={"ID":"9c2daf54-1805-4c65-b15a-88c5dcf00dc9","Type":"ContainerStarted","Data":"c2b6ee933f4c3ba67b00fa6e32b8399a2c9301a5db7afb1d5e6ef0ddafb9b09c"} Jun 09 15:24:45.075516 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.075493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" event={"ID":"b3372308-26cf-4b7e-94f1-0ddb8fca306d","Type":"ContainerStarted","Data":"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a"} Jun 09 15:24:45.075656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.075571 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" podUID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" containerName="registry-server" containerID="cri-o://f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a" gracePeriod=2 Jun 09 15:24:45.092151 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.092085 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" podStartSLOduration=1.267456961 podStartE2EDuration="3.092064005s" totalImagesPullingTime="1.824607044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:45.088746529 +0000 UTC m=+639.896505438" watchObservedRunningTime="2026-06-09 15:24:45.092064005 +0000 UTC m=+639.899822913" Jun 09 15:24:45.107038 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.106987 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" podStartSLOduration=0.722111352 podStartE2EDuration="3.106969843s" totalImagesPullingTime="2.384858491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:45.105099171 +0000 UTC m=+639.912858093" watchObservedRunningTime="2026-06-09 15:24:45.106969843 +0000 UTC m=+639.914728750" Jun 09 15:24:45.318037 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.318012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8kgqh_b3372308-26cf-4b7e-94f1-0ddb8fca306d/registry-server/0.log" Jun 09 15:24:45.320218 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.320203 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:45.508816 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.508713 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7zh4\" (UniqueName: \"kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4\") pod \"b3372308-26cf-4b7e-94f1-0ddb8fca306d\" (UID: \"b3372308-26cf-4b7e-94f1-0ddb8fca306d\") " Jun 09 15:24:45.511010 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.510985 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4" (OuterVolumeSpecName: "kube-api-access-r7zh4") pod "b3372308-26cf-4b7e-94f1-0ddb8fca306d" (UID: "b3372308-26cf-4b7e-94f1-0ddb8fca306d"). InnerVolumeSpecName "kube-api-access-r7zh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:24:45.610239 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:45.610183 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7zh4\" (UniqueName: \"kubernetes.io/projected/b3372308-26cf-4b7e-94f1-0ddb8fca306d-kube-api-access-r7zh4\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:24:46.080666 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8kgqh_b3372308-26cf-4b7e-94f1-0ddb8fca306d/registry-server/0.log" Jun 09 15:24:46.081129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080680 2566 generic.go:356] "Generic (PLEG): container finished" podID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" containerID="f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a" exitCode=1 Jun 09 15:24:46.081129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080734 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" Jun 09 15:24:46.081129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" event={"ID":"b3372308-26cf-4b7e-94f1-0ddb8fca306d","Type":"ContainerDied","Data":"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a"} Jun 09 15:24:46.081129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080818 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kgqh" event={"ID":"b3372308-26cf-4b7e-94f1-0ddb8fca306d","Type":"ContainerDied","Data":"a42ef2326e4c1edfbc22db5d6d66d447ab0c69d7e9c14d4ad99ee206a628b732"} Jun 09 15:24:46.081129 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.080837 2566 scope.go:117] "RemoveContainer" containerID="f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a" Jun 09 15:24:46.089917 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.089884 2566 scope.go:117] "RemoveContainer" containerID="f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a" Jun 09 15:24:46.090193 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:24:46.090170 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a\": container with ID starting with f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a not found: ID does not exist" containerID="f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a" Jun 09 15:24:46.090260 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.090200 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a"} err="failed to get container status \"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a\": rpc error: code = NotFound desc = could not find container \"f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a\": container with ID starting with f711781cb6479e569e06e0640dd1fa0d903ea7cdedf94e907455d443ef16b90a not found: ID does not exist" Jun 09 15:24:46.098832 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.098805 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:46.101118 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:46.101099 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kgqh"] Jun 09 15:24:47.686113 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:47.686084 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" path="/var/lib/kubelet/pods/b3372308-26cf-4b7e-94f1-0ddb8fca306d/volumes" Jun 09 15:24:52.952656 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:52.952618 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:52.953162 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:52.952687 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:52.974710 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:52.974677 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:24:53.139063 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:24:53.139033 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zw2df" Jun 09 15:25:16.061633 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.061599 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw"] Jun 09 15:25:16.062040 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.061954 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" containerName="registry-server" Jun 09 15:25:16.062040 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.061968 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" containerName="registry-server" Jun 09 15:25:16.062040 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.062032 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3372308-26cf-4b7e-94f1-0ddb8fca306d" containerName="registry-server" Jun 09 15:25:16.070465 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.070448 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.088435 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.088414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sbnh7\"" Jun 09 15:25:16.088673 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.088653 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw"] Jun 09 15:25:16.154744 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.154696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.154948 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.154777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vtz\" (UniqueName: \"kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.256069 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.256030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.256265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.256086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vtz\" (UniqueName: \"kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.256517 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.256492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.267411 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.267386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vtz\" (UniqueName: \"kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.379704 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.379609 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:16.513120 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:16.513086 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw"] Jun 09 15:25:16.517010 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:25:16.516982 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd811cff7_5f71_41ca_8718_4148bc7004ba.slice/crio-5c204af2c5bc60b59f6c92b972aef4a1c4acad9810dcb24a37b9c6f359ae30b9 WatchSource:0}: Error finding container 5c204af2c5bc60b59f6c92b972aef4a1c4acad9810dcb24a37b9c6f359ae30b9: Status 404 returned error can't find the container with id 5c204af2c5bc60b59f6c92b972aef4a1c4acad9810dcb24a37b9c6f359ae30b9 Jun 09 15:25:17.219222 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:17.219173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" event={"ID":"d811cff7-5f71-41ca-8718-4148bc7004ba","Type":"ContainerStarted","Data":"5c204af2c5bc60b59f6c92b972aef4a1c4acad9810dcb24a37b9c6f359ae30b9"} Jun 09 15:25:18.635407 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.635372 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-drjt5"] Jun 09 15:25:18.643158 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.643138 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:18.647190 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.647172 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fjf4k\"" Jun 09 15:25:18.664098 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.664067 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-drjt5"] Jun 09 15:25:18.677430 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.677407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5df\" (UniqueName: \"kubernetes.io/projected/3e423470-9a79-4733-87cd-03bc325f3d2f-kube-api-access-pn5df\") pod \"authorino-operator-75cc8d5cb7-drjt5\" (UID: \"3e423470-9a79-4733-87cd-03bc325f3d2f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:18.778658 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.778621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5df\" (UniqueName: \"kubernetes.io/projected/3e423470-9a79-4733-87cd-03bc325f3d2f-kube-api-access-pn5df\") pod \"authorino-operator-75cc8d5cb7-drjt5\" (UID: \"3e423470-9a79-4733-87cd-03bc325f3d2f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:18.792093 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.792068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5df\" (UniqueName: \"kubernetes.io/projected/3e423470-9a79-4733-87cd-03bc325f3d2f-kube-api-access-pn5df\") pod \"authorino-operator-75cc8d5cb7-drjt5\" (UID: \"3e423470-9a79-4733-87cd-03bc325f3d2f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:18.953440 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:18.953403 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:19.090568 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:19.090534 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-drjt5"] Jun 09 15:25:19.093330 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:25:19.093298 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e423470_9a79_4733_87cd_03bc325f3d2f.slice/crio-fb924bd39517e6c6779f186a241323bc5e6decf7fad300149b9c88cb81076542 WatchSource:0}: Error finding container fb924bd39517e6c6779f186a241323bc5e6decf7fad300149b9c88cb81076542: Status 404 returned error can't find the container with id fb924bd39517e6c6779f186a241323bc5e6decf7fad300149b9c88cb81076542 Jun 09 15:25:19.230383 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:19.230297 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" event={"ID":"3e423470-9a79-4733-87cd-03bc325f3d2f","Type":"ContainerStarted","Data":"fb924bd39517e6c6779f186a241323bc5e6decf7fad300149b9c88cb81076542"} Jun 09 15:25:22.246607 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:22.246568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" event={"ID":"3e423470-9a79-4733-87cd-03bc325f3d2f","Type":"ContainerStarted","Data":"6cedf1714adff2f4049c252e7586d1cc90efb3628045873d85f5b968f46b40be"} Jun 09 15:25:22.247033 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:22.246764 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:22.263606 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:22.263559 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" podStartSLOduration=2.035891315 podStartE2EDuration="4.263544118s" totalImagesPullingTime="2.227652803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:22.263326632 +0000 UTC m=+677.071085540" watchObservedRunningTime="2026-06-09 15:25:22.263544118 +0000 UTC m=+677.071303025" Jun 09 15:25:24.257982 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:24.257945 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" event={"ID":"d811cff7-5f71-41ca-8718-4148bc7004ba","Type":"ContainerStarted","Data":"b0f52448bbd85e646774fed6d323f4202d0a96e0ae95c3cc5cbf79238fb66bb7"} Jun 09 15:25:24.258475 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:24.258050 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:24.281184 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:24.281133 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" podStartSLOduration=0.680983054 podStartE2EDuration="8.281117652s" totalImagesPullingTime="7.600134598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:24.27994296 +0000 UTC m=+679.087701860" watchObservedRunningTime="2026-06-09 15:25:24.281117652 +0000 UTC m=+679.088876558" Jun 09 15:25:33.254272 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:33.254241 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-drjt5" Jun 09 15:25:35.265217 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:35.265179 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:37.104315 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.104278 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw"] Jun 09 15:25:37.104744 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.104468 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" containerName="manager" containerID="cri-o://b0f52448bbd85e646774fed6d323f4202d0a96e0ae95c3cc5cbf79238fb66bb7" gracePeriod=2 Jun 09 15:25:37.113487 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.113460 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw"] Jun 09 15:25:37.115467 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:25:37.115417 2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d811cff7-5f71-41ca-8718-4148bc7004ba\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:37.136354 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.136323 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:37.136719 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.136703 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" containerName="manager" Jun 09 15:25:37.136800 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.136722 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" containerName="manager" Jun 09 15:25:37.136852 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.136822 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" containerName="manager" Jun 09 15:25:37.139951 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.139932 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.155836 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.155801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:37.182613 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:25:37.182577 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" is forbidden: User \"system:node:ip-10-0-132-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-252.ec2.internal' and this object" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:37.254321 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.254281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lzt\" (UniqueName: \"kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.254490 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.254329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.318743 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.318706 2566 generic.go:356] "Generic (PLEG): container finished" podID="d811cff7-5f71-41ca-8718-4148bc7004ba" containerID="b0f52448bbd85e646774fed6d323f4202d0a96e0ae95c3cc5cbf79238fb66bb7" exitCode=0 Jun 09 15:25:37.349917 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.349880 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:37.354947 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:25:37.354843 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rrwdw\" is forbidden: User \"system:node:ip-10-0-132-252.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-252.ec2.internal' and this object" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:37.355088 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.355016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lzt\" (UniqueName: \"kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.355088 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.355053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.355388 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.355368 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.377290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.377265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lzt\" (UniqueName: \"kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sj2hf\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.456121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.456084 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4vtz\" (UniqueName: \"kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz\") pod \"d811cff7-5f71-41ca-8718-4148bc7004ba\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " Jun 09 15:25:37.456289 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.456203 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume\") pod \"d811cff7-5f71-41ca-8718-4148bc7004ba\" (UID: \"d811cff7-5f71-41ca-8718-4148bc7004ba\") " Jun 09 15:25:37.456680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.456647 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d811cff7-5f71-41ca-8718-4148bc7004ba" (UID: "d811cff7-5f71-41ca-8718-4148bc7004ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:37.458252 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.458220 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz" (OuterVolumeSpecName: "kube-api-access-z4vtz") pod "d811cff7-5f71-41ca-8718-4148bc7004ba" (UID: "d811cff7-5f71-41ca-8718-4148bc7004ba"). InnerVolumeSpecName "kube-api-access-z4vtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:37.493530 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.493490 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:37.557177 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.556887 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d811cff7-5f71-41ca-8718-4148bc7004ba-extensions-socket-volume\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:25:37.557177 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.556935 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4vtz\" (UniqueName: \"kubernetes.io/projected/d811cff7-5f71-41ca-8718-4148bc7004ba-kube-api-access-z4vtz\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:25:37.637168 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.637125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:37.639415 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:25:37.639387 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d2eb8d_c17c_4422_b48a_1cfb30c507f2.slice/crio-df4ed4dd47cda0dd6c84464ade428c2b40556bacd5afc40885507040decb95da WatchSource:0}: Error finding container df4ed4dd47cda0dd6c84464ade428c2b40556bacd5afc40885507040decb95da: Status 404 returned error can't find the container with id df4ed4dd47cda0dd6c84464ade428c2b40556bacd5afc40885507040decb95da Jun 09 15:25:37.686807 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:37.686780 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d811cff7-5f71-41ca-8718-4148bc7004ba" path="/var/lib/kubelet/pods/d811cff7-5f71-41ca-8718-4148bc7004ba/volumes" Jun 09 15:25:38.245285 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.245243 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r"] Jun 09 15:25:38.248962 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.248937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.263989 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.263965 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r"] Jun 09 15:25:38.324834 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.324781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" event={"ID":"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2","Type":"ContainerStarted","Data":"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b"} Jun 09 15:25:38.325056 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.324867 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" event={"ID":"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2","Type":"ContainerStarted","Data":"df4ed4dd47cda0dd6c84464ade428c2b40556bacd5afc40885507040decb95da"} Jun 09 15:25:38.331481 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.331455 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rrwdw" Jun 09 15:25:38.331648 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.331455 2566 scope.go:117] "RemoveContainer" containerID="b0f52448bbd85e646774fed6d323f4202d0a96e0ae95c3cc5cbf79238fb66bb7" Jun 09 15:25:38.357179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.357124 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" podStartSLOduration=1.3571086270000001 podStartE2EDuration="1.357108627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:38.356983026 +0000 UTC m=+693.164741933" watchObservedRunningTime="2026-06-09 15:25:38.357108627 +0000 UTC m=+693.164867534" Jun 09 15:25:38.364375 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.364344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2km6\" (UniqueName: \"kubernetes.io/projected/dce8adee-1695-4c7a-8cad-9e5f40565de9-kube-api-access-d2km6\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.364454 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.364399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce8adee-1695-4c7a-8cad-9e5f40565de9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.464927 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.464866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2km6\" (UniqueName: \"kubernetes.io/projected/dce8adee-1695-4c7a-8cad-9e5f40565de9-kube-api-access-d2km6\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.465110 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.464962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce8adee-1695-4c7a-8cad-9e5f40565de9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.465379 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.465360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce8adee-1695-4c7a-8cad-9e5f40565de9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.479849 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.479824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2km6\" (UniqueName: \"kubernetes.io/projected/dce8adee-1695-4c7a-8cad-9e5f40565de9-kube-api-access-d2km6\") pod \"kuadrant-operator-controller-manager-86878c769f-8rj7r\" (UID: \"dce8adee-1695-4c7a-8cad-9e5f40565de9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.560164 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.560074 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:38.718020 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:38.717993 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r"] Jun 09 15:25:38.721030 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:25:38.721001 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce8adee_1695_4c7a_8cad_9e5f40565de9.slice/crio-27d9b1360b5c5a2a174b19eb31a68f28c0f287c31cf33b50571d512a569115bf WatchSource:0}: Error finding container 27d9b1360b5c5a2a174b19eb31a68f28c0f287c31cf33b50571d512a569115bf: Status 404 returned error can't find the container with id 27d9b1360b5c5a2a174b19eb31a68f28c0f287c31cf33b50571d512a569115bf Jun 09 15:25:39.338930 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:39.338875 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" event={"ID":"dce8adee-1695-4c7a-8cad-9e5f40565de9","Type":"ContainerStarted","Data":"30662bf87a5750e9bc2ffe4315d9569629e42443da8d6238aa7e69b20c12e9f2"} Jun 09 15:25:39.339320 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:39.338985 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:39.339320 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:39.339027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" event={"ID":"dce8adee-1695-4c7a-8cad-9e5f40565de9","Type":"ContainerStarted","Data":"27d9b1360b5c5a2a174b19eb31a68f28c0f287c31cf33b50571d512a569115bf"} Jun 09 15:25:39.363892 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:39.363837 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" podStartSLOduration=1.363820574 podStartE2EDuration="1.363820574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:39.361037856 +0000 UTC m=+694.168796786" watchObservedRunningTime="2026-06-09 15:25:39.363820574 +0000 UTC m=+694.171579481" Jun 09 15:25:40.343327 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:40.343297 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:50.345940 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:50.345882 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:51.349713 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.349684 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8rj7r" Jun 09 15:25:51.405098 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.405067 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:51.405312 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.405265 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" podUID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" containerName="manager" containerID="cri-o://7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b" gracePeriod=10 Jun 09 15:25:51.653685 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.653656 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:51.680334 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.680304 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume\") pod \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " Jun 09 15:25:51.680502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.680420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lzt\" (UniqueName: \"kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt\") pod \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\" (UID: \"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2\") " Jun 09 15:25:51.680693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.680669 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" (UID: "f1d2eb8d-c17c-4422-b48a-1cfb30c507f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:51.683010 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.682980 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt" (OuterVolumeSpecName: "kube-api-access-m5lzt") pod "f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" (UID: "f1d2eb8d-c17c-4422-b48a-1cfb30c507f2"). InnerVolumeSpecName "kube-api-access-m5lzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:51.782121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.782083 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-extensions-socket-volume\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:25:51.782121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:51.782119 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lzt\" (UniqueName: \"kubernetes.io/projected/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2-kube-api-access-m5lzt\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:25:52.404065 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.404032 2566 generic.go:356] "Generic (PLEG): container finished" podID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" containerID="7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b" exitCode=0 Jun 09 15:25:52.404502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.404081 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" Jun 09 15:25:52.404502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.404120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" event={"ID":"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2","Type":"ContainerDied","Data":"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b"} Jun 09 15:25:52.404502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.404175 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf" event={"ID":"f1d2eb8d-c17c-4422-b48a-1cfb30c507f2","Type":"ContainerDied","Data":"df4ed4dd47cda0dd6c84464ade428c2b40556bacd5afc40885507040decb95da"} Jun 09 15:25:52.404502 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.404198 2566 scope.go:117] "RemoveContainer" containerID="7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b" Jun 09 15:25:52.413488 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.413287 2566 scope.go:117] "RemoveContainer" containerID="7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b" Jun 09 15:25:52.413608 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:25:52.413589 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b\": container with ID starting with 7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b not found: ID does not exist" containerID="7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b" Jun 09 15:25:52.413649 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.413619 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b"} err="failed to get container status \"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b\": rpc error: code = NotFound desc = could not find container \"7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b\": container with ID starting with 7d2b273d3b05fe4845bc140d3de11d264e616c0085d9d689a06e1a9c528a028b not found: ID does not exist" Jun 09 15:25:52.429953 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.429898 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:52.435768 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:52.435735 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sj2hf"] Jun 09 15:25:53.686828 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:25:53.686790 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" path="/var/lib/kubelet/pods/f1d2eb8d-c17c-4422-b48a-1cfb30c507f2/volumes" Jun 09 15:26:07.689339 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.689305 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs"] Jun 09 15:26:07.689852 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.689618 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" containerName="manager" Jun 09 15:26:07.689852 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.689628 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" containerName="manager" Jun 09 15:26:07.689852 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.689695 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d2eb8d-c17c-4422-b48a-1cfb30c507f2" containerName="manager" Jun 09 15:26:07.695455 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.695433 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.698138 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.698120 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9c8l8\"" Jun 09 15:26:07.703628 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.703605 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs"] Jun 09 15:26:07.833722 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833722 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833732 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833756 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktr2\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-kube-api-access-7ktr2\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.833990 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.833976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.834170 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.834000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.834170 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.834047 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935091 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktr2\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-kube-api-access-7ktr2\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935290 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935234 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935556 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935709 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935662 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935845 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.935938 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.936004 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.935937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.936090 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.936072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.937879 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.937861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.937991 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.937971 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.944141 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.944088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:07.944301 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:07.944282 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktr2\" (UniqueName: \"kubernetes.io/projected/8efa912d-fd6f-4b50-a8c4-52747301cbe2-kube-api-access-7ktr2\") pod \"maas-default-gateway-openshift-default-687ff6996-s6xbs\" (UID: \"8efa912d-fd6f-4b50-a8c4-52747301cbe2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:08.006816 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.006780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:08.151238 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.151212 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs"] Jun 09 15:26:08.153409 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:26:08.153380 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efa912d_fd6f_4b50_a8c4_52747301cbe2.slice/crio-cc1b0cc4a2e2b1377ffd7df3f9b6b736aef6769f15844bf8718b414c290d63c3 WatchSource:0}: Error finding container cc1b0cc4a2e2b1377ffd7df3f9b6b736aef6769f15844bf8718b414c290d63c3: Status 404 returned error can't find the container with id cc1b0cc4a2e2b1377ffd7df3f9b6b736aef6769f15844bf8718b414c290d63c3 Jun 09 15:26:08.155579 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.155546 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:26:08.155663 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.155611 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:26:08.155663 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.155641 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:26:08.481803 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.481700 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" event={"ID":"8efa912d-fd6f-4b50-a8c4-52747301cbe2","Type":"ContainerStarted","Data":"a63d07d2951615fe527406fec7614dfa79f5ce4bf59e164aa2f30b5668f8be93"} Jun 09 15:26:08.481803 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.481758 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" event={"ID":"8efa912d-fd6f-4b50-a8c4-52747301cbe2","Type":"ContainerStarted","Data":"cc1b0cc4a2e2b1377ffd7df3f9b6b736aef6769f15844bf8718b414c290d63c3"} Jun 09 15:26:08.502698 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:08.502649 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" podStartSLOduration=1.5026337779999999 podStartE2EDuration="1.502633778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:08.500055021 +0000 UTC m=+723.307813928" watchObservedRunningTime="2026-06-09 15:26:08.502633778 +0000 UTC m=+723.310392685" Jun 09 15:26:09.007582 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.007543 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:09.012376 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.012350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:09.465960 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.465927 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:09.469320 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.469298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.472615 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.472592 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j788r\"" Jun 09 15:26:09.472749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.472592 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 15:26:09.478760 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.478737 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:09.487307 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.487273 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:09.488471 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.488448 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:26:09.550574 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.550534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.550782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.550626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dgj5\" (UniqueName: \"kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.559440 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.559408 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:09.651882 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.651847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dgj5\" (UniqueName: \"kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.652107 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.652011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.652978 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.652950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.661398 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.661367 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dgj5\" (UniqueName: \"kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5\") pod \"limitador-limitador-64c94fd64f-9w552\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.780703 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.780600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:09.920824 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.920796 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:09.922634 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:26:09.922603 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41626fe_3aa7_4cd7_a434_6aabc818837e.slice/crio-d5b0c9a450e66f7b79e5e53487cc49f609896ff255db67b81b2c6cfc1371858e WatchSource:0}: Error finding container d5b0c9a450e66f7b79e5e53487cc49f609896ff255db67b81b2c6cfc1371858e: Status 404 returned error can't find the container with id d5b0c9a450e66f7b79e5e53487cc49f609896ff255db67b81b2c6cfc1371858e Jun 09 15:26:09.924787 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:09.924764 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:26:10.493743 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:10.493707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" event={"ID":"e41626fe-3aa7-4cd7-a434-6aabc818837e","Type":"ContainerStarted","Data":"d5b0c9a450e66f7b79e5e53487cc49f609896ff255db67b81b2c6cfc1371858e"} Jun 09 15:26:13.509442 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:13.509395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" event={"ID":"e41626fe-3aa7-4cd7-a434-6aabc818837e","Type":"ContainerStarted","Data":"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb"} Jun 09 15:26:13.509838 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:13.509466 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:13.527490 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:13.527429 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" podStartSLOduration=1.8049677370000001 podStartE2EDuration="4.527408665s" totalImagesPullingTime="2.722440928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:13.526616677 +0000 UTC m=+728.334375619" watchObservedRunningTime="2026-06-09 15:26:13.527408665 +0000 UTC m=+728.335167573" Jun 09 15:26:24.498503 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:24.498469 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:24.499021 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:24.498656 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" podUID="e41626fe-3aa7-4cd7-a434-6aabc818837e" containerName="limitador" containerID="cri-o://f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb" gracePeriod=30 Jun 09 15:26:24.499433 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:24.499417 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:25.056702 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.056678 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:25.193436 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.193402 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dgj5\" (UniqueName: \"kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5\") pod \"e41626fe-3aa7-4cd7-a434-6aabc818837e\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " Jun 09 15:26:25.193610 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.193481 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file\") pod \"e41626fe-3aa7-4cd7-a434-6aabc818837e\" (UID: \"e41626fe-3aa7-4cd7-a434-6aabc818837e\") " Jun 09 15:26:25.193888 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.193858 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file" (OuterVolumeSpecName: "config-file") pod "e41626fe-3aa7-4cd7-a434-6aabc818837e" (UID: "e41626fe-3aa7-4cd7-a434-6aabc818837e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:26:25.195544 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.195513 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5" (OuterVolumeSpecName: "kube-api-access-8dgj5") pod "e41626fe-3aa7-4cd7-a434-6aabc818837e" (UID: "e41626fe-3aa7-4cd7-a434-6aabc818837e"). InnerVolumeSpecName "kube-api-access-8dgj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:26:25.294760 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.294708 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e41626fe-3aa7-4cd7-a434-6aabc818837e-config-file\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:26:25.294760 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.294756 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dgj5\" (UniqueName: \"kubernetes.io/projected/e41626fe-3aa7-4cd7-a434-6aabc818837e-kube-api-access-8dgj5\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:26:25.563646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.563544 2566 generic.go:356] "Generic (PLEG): container finished" podID="e41626fe-3aa7-4cd7-a434-6aabc818837e" containerID="f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb" exitCode=0 Jun 09 15:26:25.563646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.563592 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" Jun 09 15:26:25.563646 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.563608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" event={"ID":"e41626fe-3aa7-4cd7-a434-6aabc818837e","Type":"ContainerDied","Data":"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb"} Jun 09 15:26:25.564221 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.563678 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9w552" event={"ID":"e41626fe-3aa7-4cd7-a434-6aabc818837e","Type":"ContainerDied","Data":"d5b0c9a450e66f7b79e5e53487cc49f609896ff255db67b81b2c6cfc1371858e"} Jun 09 15:26:25.564221 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.563713 2566 scope.go:117] "RemoveContainer" containerID="f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb" Jun 09 15:26:25.572402 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.572385 2566 scope.go:117] "RemoveContainer" containerID="f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb" Jun 09 15:26:25.572672 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:26:25.572653 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb\": container with ID starting with f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb not found: ID does not exist" containerID="f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb" Jun 09 15:26:25.572719 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.572681 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb"} err="failed to get container status \"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb\": rpc error: code = NotFound desc = could not find container \"f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb\": container with ID starting with f7cc46f3228d1d5625c798b9e537a152f944946a29038120d6eb65c1367d3bfb not found: ID does not exist" Jun 09 15:26:25.593206 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.593173 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:25.596314 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.596286 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9w552"] Jun 09 15:26:25.651609 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.651578 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-gmkhf"] Jun 09 15:26:25.651943 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.651931 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41626fe-3aa7-4cd7-a434-6aabc818837e" containerName="limitador" Jun 09 15:26:25.651985 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.651947 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41626fe-3aa7-4cd7-a434-6aabc818837e" containerName="limitador" Jun 09 15:26:25.652048 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.652039 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41626fe-3aa7-4cd7-a434-6aabc818837e" containerName="limitador" Jun 09 15:26:25.656138 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.656117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.660099 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.660073 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 15:26:25.676090 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.676056 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-gmkhf"] Jun 09 15:26:25.686742 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.686705 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41626fe-3aa7-4cd7-a434-6aabc818837e" path="/var/lib/kubelet/pods/e41626fe-3aa7-4cd7-a434-6aabc818837e/volumes" Jun 09 15:26:25.800346 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.800310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4tws\" (UniqueName: \"kubernetes.io/projected/c6525604-ac88-490b-beed-d19699b592d7-kube-api-access-b4tws\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.800523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.800353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6525604-ac88-490b-beed-d19699b592d7-data\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.900945 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.900888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4tws\" (UniqueName: \"kubernetes.io/projected/c6525604-ac88-490b-beed-d19699b592d7-kube-api-access-b4tws\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.901108 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.900965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6525604-ac88-490b-beed-d19699b592d7-data\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.901447 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.901413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6525604-ac88-490b-beed-d19699b592d7-data\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.912336 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.912305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4tws\" (UniqueName: \"kubernetes.io/projected/c6525604-ac88-490b-beed-d19699b592d7-kube-api-access-b4tws\") pod \"postgres-69fb4594cf-gmkhf\" (UID: \"c6525604-ac88-490b-beed-d19699b592d7\") " pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:25.966207 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:25.966168 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:26.113545 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:26.113520 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-gmkhf"] Jun 09 15:26:26.115776 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:26:26.115749 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6525604_ac88_490b_beed_d19699b592d7.slice/crio-fc9c674e092f25f82f019352bd32cf32a4b182af666b4fe7424b694c016987eb WatchSource:0}: Error finding container fc9c674e092f25f82f019352bd32cf32a4b182af666b4fe7424b694c016987eb: Status 404 returned error can't find the container with id fc9c674e092f25f82f019352bd32cf32a4b182af666b4fe7424b694c016987eb Jun 09 15:26:26.569832 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:26.569796 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-gmkhf" event={"ID":"c6525604-ac88-490b-beed-d19699b592d7","Type":"ContainerStarted","Data":"fc9c674e092f25f82f019352bd32cf32a4b182af666b4fe7424b694c016987eb"} Jun 09 15:26:31.599157 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:31.599121 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-gmkhf" event={"ID":"c6525604-ac88-490b-beed-d19699b592d7","Type":"ContainerStarted","Data":"34024d700fea7b6126dce7eb7ab563178123159e9739b0b0011f48c3246c312d"} Jun 09 15:26:31.599564 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:31.599240 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:37.633043 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:37.633013 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-gmkhf" Jun 09 15:26:37.653464 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:26:37.653411 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-gmkhf" podStartSLOduration=7.894493292 podStartE2EDuration="12.653392648s" totalImagesPullingTime="4.758899356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:31.627834718 +0000 UTC m=+746.435593626" watchObservedRunningTime="2026-06-09 15:26:37.653392648 +0000 UTC m=+752.461151554" Jun 09 15:27:08.489700 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.489667 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:27:08.494666 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.494645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:08.498951 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.498922 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:27:08.498951 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.498930 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:27:08.499178 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.499162 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xbn86\"" Jun 09 15:27:08.500257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.500235 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:27:08.517209 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.517175 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:27:08.597082 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.597039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwz8\" (UniqueName: \"kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8\") pod \"maas-keycloak-0\" (UID: \"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:08.698006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.697969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwz8\" (UniqueName: \"kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8\") pod \"maas-keycloak-0\" (UID: \"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:08.715805 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.715774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwz8\" (UniqueName: \"kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8\") pod \"maas-keycloak-0\" (UID: \"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:08.805036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.804956 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:08.953250 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:08.953217 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:27:08.960185 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:27:08.956924 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4a4b71_abd8_48a0_ab49_d6f9e9fa0c12.slice/crio-270306def2fba0e3db489abf935e7c79c8c9f0f1dcd097c802d4a5ce3877677f WatchSource:0}: Error finding container 270306def2fba0e3db489abf935e7c79c8c9f0f1dcd097c802d4a5ce3877677f: Status 404 returned error can't find the container with id 270306def2fba0e3db489abf935e7c79c8c9f0f1dcd097c802d4a5ce3877677f Jun 09 15:27:09.785455 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:09.785414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12","Type":"ContainerStarted","Data":"270306def2fba0e3db489abf935e7c79c8c9f0f1dcd097c802d4a5ce3877677f"} Jun 09 15:27:15.821795 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:15.821750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12","Type":"ContainerStarted","Data":"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab"} Jun 09 15:27:15.872973 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:15.872878 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.02385982 podStartE2EDuration="7.872855059s" totalImagesPullingTime="5.848995239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:27:15.867952018 +0000 UTC m=+790.675710928" watchObservedRunningTime="2026-06-09 15:27:15.872855059 +0000 UTC m=+790.680613967" Jun 09 15:27:16.806258 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:16.806215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:16.808063 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:16.808028 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:17.806238 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:17.806195 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:18.805596 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:18.805539 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:18.805880 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:18.805843 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:19.806453 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:19.806394 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:20.805856 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:20.805804 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:21.805606 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:21.805546 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:22.806447 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:22.806388 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:23.806206 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:23.806160 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:24.805662 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:24.805623 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:25.805726 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:25.805666 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:26.806390 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:26.806346 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:27.806026 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:27.805985 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 09 15:27:28.896899 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:28.896851 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:28.915804 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:28.915740 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:27:38.903217 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:38.903180 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:27:46.018353 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.018319 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:27:46.029783 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.029754 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.032513 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.032487 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 15:27:46.032947 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.032934 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qclx9\"" Jun 09 15:27:46.033745 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.033691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 15:27:46.036937 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.036891 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:27:46.077544 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.077510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.077544 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.077553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h58fd\" (UniqueName: \"kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.179039 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.178999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.179039 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.179042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h58fd\" (UniqueName: \"kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.181637 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.181615 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.192450 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.192419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h58fd\" (UniqueName: \"kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd\") pod \"maas-controller-86c868586c-6hdjc\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.255199 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.255165 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:27:46.258655 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.258636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.273444 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.273372 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:27:46.279680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.279653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.279825 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.279719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qj4b\" (UniqueName: \"kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.343289 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.343246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:46.380465 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.380428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qj4b\" (UniqueName: \"kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.380667 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.380525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.383041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.383010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.391751 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.391722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qj4b\" (UniqueName: \"kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b\") pod \"maas-controller-9fd8f779b-bpgrj\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.481629 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.481606 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:27:46.483374 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:27:46.483342 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46635d80_342f_4f11_8315_7d143ca82bab.slice/crio-fc0a457bcfce21ccb21f2c345ccc3ce5cb110b950ae429411921a7dbb7577a02 WatchSource:0}: Error finding container fc0a457bcfce21ccb21f2c345ccc3ce5cb110b950ae429411921a7dbb7577a02: Status 404 returned error can't find the container with id fc0a457bcfce21ccb21f2c345ccc3ce5cb110b950ae429411921a7dbb7577a02 Jun 09 15:27:46.569271 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.569173 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:46.708446 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.708416 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:27:46.711643 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:27:46.711619 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb990fc83_d59b_4418_af2b_25b67cd1b174.slice/crio-70963ca35c467683172e0e4acef4b53dba7070c522812a631ebef1565e87f679 WatchSource:0}: Error finding container 70963ca35c467683172e0e4acef4b53dba7070c522812a631ebef1565e87f679: Status 404 returned error can't find the container with id 70963ca35c467683172e0e4acef4b53dba7070c522812a631ebef1565e87f679 Jun 09 15:27:46.999293 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:46.999254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c868586c-6hdjc" event={"ID":"46635d80-342f-4f11-8315-7d143ca82bab","Type":"ContainerStarted","Data":"fc0a457bcfce21ccb21f2c345ccc3ce5cb110b950ae429411921a7dbb7577a02"} Jun 09 15:27:47.000492 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:47.000466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" event={"ID":"b990fc83-d59b-4418-af2b-25b67cd1b174","Type":"ContainerStarted","Data":"70963ca35c467683172e0e4acef4b53dba7070c522812a631ebef1565e87f679"} Jun 09 15:27:50.018167 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.018128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c868586c-6hdjc" event={"ID":"46635d80-342f-4f11-8315-7d143ca82bab","Type":"ContainerStarted","Data":"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff"} Jun 09 15:27:50.018644 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.018222 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:27:50.019706 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.019683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" event={"ID":"b990fc83-d59b-4418-af2b-25b67cd1b174","Type":"ContainerStarted","Data":"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00"} Jun 09 15:27:50.019843 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.019801 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:27:50.077077 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.077022 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86c868586c-6hdjc" podStartSLOduration=2.219099364 podStartE2EDuration="5.077005683s" totalImagesPullingTime="2.857906319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:27:50.075949248 +0000 UTC m=+824.883708151" watchObservedRunningTime="2026-06-09 15:27:50.077005683 +0000 UTC m=+824.884764604" Jun 09 15:27:50.141523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:27:50.141470 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" podStartSLOduration=1.500973234 podStartE2EDuration="4.1414489s" totalImagesPullingTime="2.640475666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:27:50.140158295 +0000 UTC m=+824.947917203" watchObservedRunningTime="2026-06-09 15:27:50.1414489 +0000 UTC m=+824.949207899" Jun 09 15:28:01.031480 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.031445 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:28:01.031964 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.031521 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:28:01.105223 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.105192 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:28:01.105379 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.105362 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-86c868586c-6hdjc" podUID="46635d80-342f-4f11-8315-7d143ca82bab" containerName="manager" containerID="cri-o://a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff" gracePeriod=30 Jun 09 15:28:01.345637 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.345609 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:28:01.425682 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.425640 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h58fd\" (UniqueName: \"kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd\") pod \"46635d80-342f-4f11-8315-7d143ca82bab\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " Jun 09 15:28:01.425859 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.425709 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert\") pod \"46635d80-342f-4f11-8315-7d143ca82bab\" (UID: \"46635d80-342f-4f11-8315-7d143ca82bab\") " Jun 09 15:28:01.427994 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.427970 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd" (OuterVolumeSpecName: "kube-api-access-h58fd") pod "46635d80-342f-4f11-8315-7d143ca82bab" (UID: "46635d80-342f-4f11-8315-7d143ca82bab"). InnerVolumeSpecName "kube-api-access-h58fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:28:01.428112 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.428091 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46635d80-342f-4f11-8315-7d143ca82bab" (UID: "46635d80-342f-4f11-8315-7d143ca82bab"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:28:01.527121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.527072 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46635d80-342f-4f11-8315-7d143ca82bab-webhook-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:28:01.527121 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:01.527116 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h58fd\" (UniqueName: \"kubernetes.io/projected/46635d80-342f-4f11-8315-7d143ca82bab-kube-api-access-h58fd\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:28:02.091604 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.091501 2566 generic.go:356] "Generic (PLEG): container finished" podID="46635d80-342f-4f11-8315-7d143ca82bab" containerID="a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff" exitCode=0 Jun 09 15:28:02.091604 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.091564 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c868586c-6hdjc" Jun 09 15:28:02.091604 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.091585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c868586c-6hdjc" event={"ID":"46635d80-342f-4f11-8315-7d143ca82bab","Type":"ContainerDied","Data":"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff"} Jun 09 15:28:02.092179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.091672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c868586c-6hdjc" event={"ID":"46635d80-342f-4f11-8315-7d143ca82bab","Type":"ContainerDied","Data":"fc0a457bcfce21ccb21f2c345ccc3ce5cb110b950ae429411921a7dbb7577a02"} Jun 09 15:28:02.092179 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.091697 2566 scope.go:117] "RemoveContainer" containerID="a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff" Jun 09 15:28:02.100600 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.100581 2566 scope.go:117] "RemoveContainer" containerID="a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff" Jun 09 15:28:02.100974 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:28:02.100948 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff\": container with ID starting with a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff not found: ID does not exist" containerID="a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff" Jun 09 15:28:02.101036 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.100987 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff"} err="failed to get container status \"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff\": rpc error: code = NotFound desc = could not find container \"a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff\": container with ID starting with a0cb0c07e9dcca29a74d097519d2605dbfb57a550294c2cfc52f616793e625ff not found: ID does not exist" Jun 09 15:28:02.110572 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.110543 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:28:02.116209 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:02.116178 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86c868586c-6hdjc"] Jun 09 15:28:03.687212 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:03.687178 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46635d80-342f-4f11-8315-7d143ca82bab" path="/var/lib/kubelet/pods/46635d80-342f-4f11-8315-7d143ca82bab/volumes" Jun 09 15:28:20.675237 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.675199 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8499dc845d-5nllt"] Jun 09 15:28:20.675814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.675623 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46635d80-342f-4f11-8315-7d143ca82bab" containerName="manager" Jun 09 15:28:20.675814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.675637 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46635d80-342f-4f11-8315-7d143ca82bab" containerName="manager" Jun 09 15:28:20.675814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.675732 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46635d80-342f-4f11-8315-7d143ca82bab" containerName="manager" Jun 09 15:28:20.679521 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.679505 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:20.682202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.682182 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 15:28:20.690601 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.690578 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8499dc845d-5nllt"] Jun 09 15:28:20.802489 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.802450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rrn\" (UniqueName: \"kubernetes.io/projected/6aed4aaf-1974-4439-b025-7aaf879b22f4-kube-api-access-98rrn\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:20.802666 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.802595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:20.903518 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.903485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rrn\" (UniqueName: \"kubernetes.io/projected/6aed4aaf-1974-4439-b025-7aaf879b22f4-kube-api-access-98rrn\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:20.903518 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.903523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:20.903787 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:28:20.903643 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 15:28:20.903787 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:28:20.903699 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls podName:6aed4aaf-1974-4439-b025-7aaf879b22f4 nodeName:}" failed. No retries permitted until 2026-06-09 15:28:21.403682801 +0000 UTC m=+856.211441686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls") pod "maas-api-8499dc845d-5nllt" (UID: "6aed4aaf-1974-4439-b025-7aaf879b22f4") : secret "maas-api-serving-cert" not found Jun 09 15:28:20.915704 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:20.915621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rrn\" (UniqueName: \"kubernetes.io/projected/6aed4aaf-1974-4439-b025-7aaf879b22f4-kube-api-access-98rrn\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:21.199330 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.199288 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-5rn92"] Jun 09 15:28:21.208699 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.208659 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:21.211478 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.211428 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 15:28:21.214350 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.214324 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-5rn92"] Jun 09 15:28:21.237265 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.237234 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5sg5z"] Jun 09 15:28:21.240712 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.240694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:21.243811 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.243786 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v8wm7\"" Jun 09 15:28:21.250618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.250595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5sg5z"] Jun 09 15:28:21.309334 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.309296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblcp\" (UniqueName: \"kubernetes.io/projected/1999fbed-f11c-4189-8120-20005ce3b9b6-kube-api-access-kblcp\") pod \"payload-processing-7c6c859784-5rn92\" (UID: \"1999fbed-f11c-4189-8120-20005ce3b9b6\") " pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:21.410181 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.410138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgtg\" (UniqueName: \"kubernetes.io/projected/583f147c-2996-4e5e-b327-e898e36ac967-kube-api-access-4sgtg\") pod \"payload-pre-processing-67d7689b65-5sg5z\" (UID: \"583f147c-2996-4e5e-b327-e898e36ac967\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:21.410383 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.410213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:21.410383 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.410336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblcp\" (UniqueName: \"kubernetes.io/projected/1999fbed-f11c-4189-8120-20005ce3b9b6-kube-api-access-kblcp\") pod \"payload-processing-7c6c859784-5rn92\" (UID: \"1999fbed-f11c-4189-8120-20005ce3b9b6\") " pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:21.416481 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.416444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aed4aaf-1974-4439-b025-7aaf879b22f4-maas-api-tls\") pod \"maas-api-8499dc845d-5nllt\" (UID: \"6aed4aaf-1974-4439-b025-7aaf879b22f4\") " pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:21.420048 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.420019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblcp\" (UniqueName: \"kubernetes.io/projected/1999fbed-f11c-4189-8120-20005ce3b9b6-kube-api-access-kblcp\") pod \"payload-processing-7c6c859784-5rn92\" (UID: \"1999fbed-f11c-4189-8120-20005ce3b9b6\") " pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:21.510967 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.510845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgtg\" (UniqueName: \"kubernetes.io/projected/583f147c-2996-4e5e-b327-e898e36ac967-kube-api-access-4sgtg\") pod \"payload-pre-processing-67d7689b65-5sg5z\" (UID: \"583f147c-2996-4e5e-b327-e898e36ac967\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:21.520514 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.520208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgtg\" (UniqueName: \"kubernetes.io/projected/583f147c-2996-4e5e-b327-e898e36ac967-kube-api-access-4sgtg\") pod \"payload-pre-processing-67d7689b65-5sg5z\" (UID: \"583f147c-2996-4e5e-b327-e898e36ac967\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:21.521368 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.521344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:21.551164 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.551133 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:21.590674 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.590640 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:21.716938 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.716794 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-5rn92"] Jun 09 15:28:21.719218 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:28:21.719187 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1999fbed_f11c_4189_8120_20005ce3b9b6.slice/crio-a30b480c7eb3d3e61d1acf50276e8912a4b57c2136383a70a1f871b8633043c8 WatchSource:0}: Error finding container a30b480c7eb3d3e61d1acf50276e8912a4b57c2136383a70a1f871b8633043c8: Status 404 returned error can't find the container with id a30b480c7eb3d3e61d1acf50276e8912a4b57c2136383a70a1f871b8633043c8 Jun 09 15:28:21.749319 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.749284 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5sg5z"] Jun 09 15:28:21.752693 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:28:21.752654 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583f147c_2996_4e5e_b327_e898e36ac967.slice/crio-9969546feb531cb2fc4ecd74feff4d9e38f591bd35212f707f89cf62fb382798 WatchSource:0}: Error finding container 9969546feb531cb2fc4ecd74feff4d9e38f591bd35212f707f89cf62fb382798: Status 404 returned error can't find the container with id 9969546feb531cb2fc4ecd74feff4d9e38f591bd35212f707f89cf62fb382798 Jun 09 15:28:21.778464 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:21.778370 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8499dc845d-5nllt"] Jun 09 15:28:21.781276 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:28:21.781245 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aed4aaf_1974_4439_b025_7aaf879b22f4.slice/crio-013ce213580e59370b0ed4bf128b322488bea5264c4e9d788153dbe7f5202a8b WatchSource:0}: Error finding container 013ce213580e59370b0ed4bf128b322488bea5264c4e9d788153dbe7f5202a8b: Status 404 returned error can't find the container with id 013ce213580e59370b0ed4bf128b322488bea5264c4e9d788153dbe7f5202a8b Jun 09 15:28:22.186282 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:22.186246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" event={"ID":"583f147c-2996-4e5e-b327-e898e36ac967","Type":"ContainerStarted","Data":"9969546feb531cb2fc4ecd74feff4d9e38f591bd35212f707f89cf62fb382798"} Jun 09 15:28:22.187398 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:22.187372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"a30b480c7eb3d3e61d1acf50276e8912a4b57c2136383a70a1f871b8633043c8"} Jun 09 15:28:22.188468 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:22.188446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8499dc845d-5nllt" event={"ID":"6aed4aaf-1974-4439-b025-7aaf879b22f4","Type":"ContainerStarted","Data":"013ce213580e59370b0ed4bf128b322488bea5264c4e9d788153dbe7f5202a8b"} Jun 09 15:28:24.200063 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.200025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" event={"ID":"583f147c-2996-4e5e-b327-e898e36ac967","Type":"ContainerStarted","Data":"ffa47007bf251cfb9b6d9413ee242cb94d544f2958cf8ed5254f716f13153513"} Jun 09 15:28:24.200498 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.200201 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:24.201479 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.201454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"2aead2cdb52d9471e23152998c41a79b3168f7bb99276bc761dcc816ffa5c774"} Jun 09 15:28:24.201585 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.201512 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:24.202828 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.202804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8499dc845d-5nllt" event={"ID":"6aed4aaf-1974-4439-b025-7aaf879b22f4","Type":"ContainerStarted","Data":"9d4f5a147530957baa8409746082fbef427f2b09b831d2cf02f7e5a403b7d527"} Jun 09 15:28:24.202945 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.202855 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:24.218824 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.218762 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" podStartSLOduration=1.122904105 podStartE2EDuration="3.218742111s" totalImagesPullingTime="2.095838006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:28:24.218180896 +0000 UTC m=+859.025939804" watchObservedRunningTime="2026-06-09 15:28:24.218742111 +0000 UTC m=+859.026501019" Jun 09 15:28:24.238346 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.238276 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podStartSLOduration=1.111340748 podStartE2EDuration="3.238252775s" totalImagesPullingTime="2.126912027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:28:24.237497318 +0000 UTC m=+859.045256223" watchObservedRunningTime="2026-06-09 15:28:24.238252775 +0000 UTC m=+859.046011681" Jun 09 15:28:24.263143 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:24.263091 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8499dc845d-5nllt" podStartSLOduration=2.159051986 podStartE2EDuration="4.263074275s" totalImagesPullingTime="2.104022289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:28:24.261114883 +0000 UTC m=+859.068873794" watchObservedRunningTime="2026-06-09 15:28:24.263074275 +0000 UTC m=+859.070833182" Jun 09 15:28:29.234583 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.234553 2566 generic.go:356] "Generic (PLEG): container finished" podID="8efa912d-fd6f-4b50-a8c4-52747301cbe2" containerID="a63d07d2951615fe527406fec7614dfa79f5ce4bf59e164aa2f30b5668f8be93" exitCode=0 Jun 09 15:28:29.235051 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.234624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" event={"ID":"8efa912d-fd6f-4b50-a8c4-52747301cbe2","Type":"ContainerDied","Data":"a63d07d2951615fe527406fec7614dfa79f5ce4bf59e164aa2f30b5668f8be93"} Jun 09 15:28:29.235051 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.235039 2566 scope.go:117] "RemoveContainer" containerID="a63d07d2951615fe527406fec7614dfa79f5ce4bf59e164aa2f30b5668f8be93" Jun 09 15:28:29.236008 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.235984 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:28:29.236066 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.236050 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:28:29.236114 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:29.236084 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:28:30.229236 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:30.229196 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8499dc845d-5nllt" Jun 09 15:28:30.241458 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:30.241427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" event={"ID":"8efa912d-fd6f-4b50-a8c4-52747301cbe2","Type":"ContainerStarted","Data":"643c818f1f54f0fdfe3aca9e02b25c6fa8f98a4be3769d15ec9e3689fe5ef0df"} Jun 09 15:28:31.007890 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:31.007850 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:28:31.008479 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:31.008388 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-s6xbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 09 15:28:31.008661 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:31.008636 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" podUID="8efa912d-fd6f-4b50-a8c4-52747301cbe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 09 15:28:32.007925 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:32.007869 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-s6xbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 09 15:28:32.008483 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:32.007969 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" podUID="8efa912d-fd6f-4b50-a8c4-52747301cbe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 09 15:28:32.239193 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:32.239156 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:32.239388 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:32.239349 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" containerID="cri-o://5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab" gracePeriod=30 Jun 09 15:28:33.007693 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:33.007643 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-s6xbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 09 15:28:33.007936 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:33.007718 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" podUID="8efa912d-fd6f-4b50-a8c4-52747301cbe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 09 15:28:33.922640 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:33.921198 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:33.950936 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:33.950832 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrwz8\" (UniqueName: \"kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8\") pod \"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12\" (UID: \"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12\") " Jun 09 15:28:33.953231 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:33.953192 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8" (OuterVolumeSpecName: "kube-api-access-lrwz8") pod "ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" (UID: "ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12"). InnerVolumeSpecName "kube-api-access-lrwz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:28:34.023933 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.019324 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-s6xbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 09 15:28:34.023933 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.019388 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" podUID="8efa912d-fd6f-4b50-a8c4-52747301cbe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 09 15:28:34.052200 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.052159 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrwz8\" (UniqueName: \"kubernetes.io/projected/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12-kube-api-access-lrwz8\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:28:34.261680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.261582 2566 generic.go:356] "Generic (PLEG): container finished" podID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerID="5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab" exitCode=143 Jun 09 15:28:34.261680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.261626 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.261680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.261665 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12","Type":"ContainerDied","Data":"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab"} Jun 09 15:28:34.262034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.261714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12","Type":"ContainerDied","Data":"270306def2fba0e3db489abf935e7c79c8c9f0f1dcd097c802d4a5ce3877677f"} Jun 09 15:28:34.262034 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.261735 2566 scope.go:117] "RemoveContainer" containerID="5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab" Jun 09 15:28:34.271008 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.270989 2566 scope.go:117] "RemoveContainer" containerID="5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab" Jun 09 15:28:34.271276 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:28:34.271257 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab\": container with ID starting with 5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab not found: ID does not exist" containerID="5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab" Jun 09 15:28:34.271337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.271290 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab"} err="failed to get container status \"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab\": rpc error: code = NotFound desc = could not find container \"5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab\": container with ID starting with 5be0febb1c139b61b241d60814ea3074174c09183336ff45caa77b662b7f83ab not found: ID does not exist" Jun 09 15:28:34.283692 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.283654 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:34.290515 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.290493 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:34.328419 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.328392 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:34.328782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.328770 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" Jun 09 15:28:34.328839 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.328783 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" Jun 09 15:28:34.328882 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.328868 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" containerName="keycloak" Jun 09 15:28:34.333801 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.333778 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.337584 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.337563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:28:34.337584 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.337573 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 15:28:34.337736 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.337721 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xbn86\"" Jun 09 15:28:34.337868 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.337853 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:28:34.338306 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.338287 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:28:34.344396 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.344376 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:34.354490 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.354458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6912ff25-d631-4a31-a173-a86f24dfc044-test-realms\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.354660 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.354528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4nrh\" (UniqueName: \"kubernetes.io/projected/6912ff25-d631-4a31-a173-a86f24dfc044-kube-api-access-r4nrh\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.455012 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.454973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6912ff25-d631-4a31-a173-a86f24dfc044-test-realms\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.455190 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.455077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4nrh\" (UniqueName: \"kubernetes.io/projected/6912ff25-d631-4a31-a173-a86f24dfc044-kube-api-access-r4nrh\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.455701 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.455683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6912ff25-d631-4a31-a173-a86f24dfc044-test-realms\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.464519 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.464502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4nrh\" (UniqueName: \"kubernetes.io/projected/6912ff25-d631-4a31-a173-a86f24dfc044-kube-api-access-r4nrh\") pod \"maas-keycloak-0\" (UID: \"6912ff25-d631-4a31-a173-a86f24dfc044\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.644541 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.644438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:34.784975 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:34.784947 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:28:34.786929 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:28:34.786873 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6912ff25_d631_4a31_a173_a86f24dfc044.slice/crio-f3c738224de4b81e9ace2c60b3c206b17664f6ec26a33458404af8efdea729e6 WatchSource:0}: Error finding container f3c738224de4b81e9ace2c60b3c206b17664f6ec26a33458404af8efdea729e6: Status 404 returned error can't find the container with id f3c738224de4b81e9ace2c60b3c206b17664f6ec26a33458404af8efdea729e6 Jun 09 15:28:35.011119 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.011041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:28:35.011487 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.011293 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:28:35.011970 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.011899 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-s6xbs" Jun 09 15:28:35.212822 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.212791 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:28:35.213027 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.212874 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-5sg5z" Jun 09 15:28:35.271336 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.271239 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6912ff25-d631-4a31-a173-a86f24dfc044","Type":"ContainerStarted","Data":"f3c738224de4b81e9ace2c60b3c206b17664f6ec26a33458404af8efdea729e6"} Jun 09 15:28:35.689921 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:35.689867 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12" path="/var/lib/kubelet/pods/ea4a4b71-abd8-48a0-ab49-d6f9e9fa0c12/volumes" Jun 09 15:28:36.278882 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:36.278845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6912ff25-d631-4a31-a173-a86f24dfc044","Type":"ContainerStarted","Data":"ad39817415478eeac77fd05c190f32c60234b97977dc6c3d89c1343cc4d88598"} Jun 09 15:28:36.299047 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:36.298990 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.7508720599999998 podStartE2EDuration="2.298972821s" totalImagesPullingTime="548.100761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:28:36.296645425 +0000 UTC m=+871.104404331" watchObservedRunningTime="2026-06-09 15:28:36.298972821 +0000 UTC m=+871.106731728" Jun 09 15:28:36.645350 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:36.645307 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:36.647546 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:36.647506 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:37.645245 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:37.645197 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:38.645831 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:38.645783 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:39.645600 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:39.645551 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:40.645373 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:40.645323 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:41.644947 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:41.644871 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:42.645798 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:42.645724 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:43.644978 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:43.644929 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:44.645111 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:44.645076 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:44.645622 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:44.645353 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:45.645705 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:45.645656 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:46.645655 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:46.645603 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:47.645504 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:47.645466 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:48.645783 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:48.645734 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 09 15:28:49.772947 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:49.772879 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:28:49.791565 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:49.791521 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6912ff25-d631-4a31-a173-a86f24dfc044" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:28:59.779462 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:28:59.779428 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:29:05.695425 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:05.695399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:29:05.697548 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:05.697526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:29:28.040778 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.040734 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p"] Jun 09 15:29:28.045477 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.045448 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.049592 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.049569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-245xv\"" Jun 09 15:29:28.049749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.049572 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 15:29:28.049749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.049606 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 15:29:28.049749 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.049606 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 15:29:28.058763 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.058733 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p"] Jun 09 15:29:28.174592 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0276954-9eae-4d13-8c63-05cf1bebdf01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.174782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.174782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.174782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.174977 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbvq9\" (UniqueName: \"kubernetes.io/projected/e0276954-9eae-4d13-8c63-05cf1bebdf01-kube-api-access-xbvq9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.174977 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.174850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276381 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0276954-9eae-4d13-8c63-05cf1bebdf01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276578 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276578 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276578 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276578 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbvq9\" (UniqueName: \"kubernetes.io/projected/e0276954-9eae-4d13-8c63-05cf1bebdf01-kube-api-access-xbvq9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.276804 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.277015 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276886 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.277015 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.276960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.277181 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.277106 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.278851 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.278832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0276954-9eae-4d13-8c63-05cf1bebdf01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.279330 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.279314 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0276954-9eae-4d13-8c63-05cf1bebdf01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.285208 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.285185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbvq9\" (UniqueName: \"kubernetes.io/projected/e0276954-9eae-4d13-8c63-05cf1bebdf01-kube-api-access-xbvq9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nkm7p\" (UID: \"e0276954-9eae-4d13-8c63-05cf1bebdf01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.357998 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.357890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:28.499152 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.499125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p"] Jun 09 15:29:28.501589 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:29:28.501564 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0276954_9eae_4d13_8c63_05cf1bebdf01.slice/crio-6bbe926349ec535f2db7777f8396f8937c1a1eb50f1ee608153403c280bd42dd WatchSource:0}: Error finding container 6bbe926349ec535f2db7777f8396f8937c1a1eb50f1ee608153403c280bd42dd: Status 404 returned error can't find the container with id 6bbe926349ec535f2db7777f8396f8937c1a1eb50f1ee608153403c280bd42dd Jun 09 15:29:28.574609 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:28.574555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" event={"ID":"e0276954-9eae-4d13-8c63-05cf1bebdf01","Type":"ContainerStarted","Data":"6bbe926349ec535f2db7777f8396f8937c1a1eb50f1ee608153403c280bd42dd"} Jun 09 15:29:32.605831 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:32.605785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" event={"ID":"e0276954-9eae-4d13-8c63-05cf1bebdf01","Type":"ContainerStarted","Data":"c93712c18c964a1a5278b7433071656debc925a22a7af0231d0e614b16b63a69"} Jun 09 15:29:33.612146 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:33.612052 2566 generic.go:356] "Generic (PLEG): container finished" podID="e0276954-9eae-4d13-8c63-05cf1bebdf01" containerID="c93712c18c964a1a5278b7433071656debc925a22a7af0231d0e614b16b63a69" exitCode=0 Jun 09 15:29:33.612513 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:33.612143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" event={"ID":"e0276954-9eae-4d13-8c63-05cf1bebdf01","Type":"ContainerDied","Data":"c93712c18c964a1a5278b7433071656debc925a22a7af0231d0e614b16b63a69"} Jun 09 15:29:35.625397 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:35.625356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" event={"ID":"e0276954-9eae-4d13-8c63-05cf1bebdf01","Type":"ContainerStarted","Data":"cf035f8cbcfbbccd591ddd22f9c8ee6d6554b9ae9e030a58d566ac70be03c1b2"} Jun 09 15:29:35.649006 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:35.648958 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" podStartSLOduration=1.6418164910000002 podStartE2EDuration="7.648943488s" totalImagesPullingTime="4.715308711s" totalInitContainerRuntime="1.291818286s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:29:35.647373227 +0000 UTC m=+930.455132137" watchObservedRunningTime="2026-06-09 15:29:35.648943488 +0000 UTC m=+930.456702411" Jun 09 15:29:38.358635 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.358573 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:38.359113 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.358672 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:38.371335 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.371309 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:38.642102 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.642070 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7"] Jun 09 15:29:38.647397 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.647374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.650156 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.650135 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 15:29:38.655868 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.655844 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nkm7p" Jun 09 15:29:38.669618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.669578 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7"] Jun 09 15:29:38.779586 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.779586 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2r6w\" (UniqueName: \"kubernetes.io/projected/b152c183-324e-4cda-9e44-cae505002c30-kube-api-access-v2r6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.779803 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.779849 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.779849 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b152c183-324e-4cda-9e44-cae505002c30-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.779949 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.779921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881000 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.880968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b152c183-324e-4cda-9e44-cae505002c30-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881119 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881202 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2r6w\" (UniqueName: \"kubernetes.io/projected/b152c183-324e-4cda-9e44-cae505002c30-kube-api-access-v2r6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881484 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881484 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.881568 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.881533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.883484 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.883462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b152c183-324e-4cda-9e44-cae505002c30-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.883649 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.883632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b152c183-324e-4cda-9e44-cae505002c30-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.890060 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.890041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2r6w\" (UniqueName: \"kubernetes.io/projected/b152c183-324e-4cda-9e44-cae505002c30-kube-api-access-v2r6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7\" (UID: \"b152c183-324e-4cda-9e44-cae505002c30\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:38.959457 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:38.959364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:39.108864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:39.108838 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7"] Jun 09 15:29:39.110443 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:29:39.110413 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb152c183_324e_4cda_9e44_cae505002c30.slice/crio-f3685390d09c02c820df59d5cce9c04808b3a1d91e3e0c38eed9365125d51cec WatchSource:0}: Error finding container f3685390d09c02c820df59d5cce9c04808b3a1d91e3e0c38eed9365125d51cec: Status 404 returned error can't find the container with id f3685390d09c02c820df59d5cce9c04808b3a1d91e3e0c38eed9365125d51cec Jun 09 15:29:39.648652 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:39.648613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" event={"ID":"b152c183-324e-4cda-9e44-cae505002c30","Type":"ContainerStarted","Data":"12ab241953d16054a4914d17f2ce2936543391a1144b1a6a751e1f4f3bc34588"} Jun 09 15:29:39.649203 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:39.648674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" event={"ID":"b152c183-324e-4cda-9e44-cae505002c30","Type":"ContainerStarted","Data":"f3685390d09c02c820df59d5cce9c04808b3a1d91e3e0c38eed9365125d51cec"} Jun 09 15:29:40.655334 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:40.655300 2566 generic.go:356] "Generic (PLEG): container finished" podID="b152c183-324e-4cda-9e44-cae505002c30" containerID="12ab241953d16054a4914d17f2ce2936543391a1144b1a6a751e1f4f3bc34588" exitCode=0 Jun 09 15:29:40.655796 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:40.655395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" event={"ID":"b152c183-324e-4cda-9e44-cae505002c30","Type":"ContainerDied","Data":"12ab241953d16054a4914d17f2ce2936543391a1144b1a6a751e1f4f3bc34588"} Jun 09 15:29:41.662680 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:41.662645 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" event={"ID":"b152c183-324e-4cda-9e44-cae505002c30","Type":"ContainerStarted","Data":"676213f8c300d74b183064570e8a1ef226ac07a39595075a75f8a4f9b9d22570"} Jun 09 15:29:41.687731 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:41.686872 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" podStartSLOduration=2.170164416 podStartE2EDuration="3.686849681s" totalImagesPullingTime="216.283233ms" totalInitContainerRuntime="1.300402032s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:29:41.684138693 +0000 UTC m=+936.491897626" watchObservedRunningTime="2026-06-09 15:29:41.686849681 +0000 UTC m=+936.494608590" Jun 09 15:29:48.923343 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.923304 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp"] Jun 09 15:29:48.946523 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.946486 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp"] Jun 09 15:29:48.946705 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.946620 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.949333 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.949312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 15:29:48.959968 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.959946 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:48.960076 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.959995 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:48.967222 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9cb9b-ebff-4335-b709-aef600df008e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.967348 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.967348 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.967348 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.967348 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.967564 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.967441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j78xg\" (UniqueName: \"kubernetes.io/projected/cbf9cb9b-ebff-4335-b709-aef600df008e-kube-api-access-j78xg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:48.974409 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:48.974379 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:29:49.068228 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068438 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068438 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j78xg\" (UniqueName: \"kubernetes.io/projected/cbf9cb9b-ebff-4335-b709-aef600df008e-kube-api-access-j78xg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068438 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9cb9b-ebff-4335-b709-aef600df008e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068607 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068607 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068739 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068800 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068770 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.068845 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.068799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.070867 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.070843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbf9cb9b-ebff-4335-b709-aef600df008e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.071222 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.071205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9cb9b-ebff-4335-b709-aef600df008e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.076782 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.076762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j78xg\" (UniqueName: \"kubernetes.io/projected/cbf9cb9b-ebff-4335-b709-aef600df008e-kube-api-access-j78xg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zsplp\" (UID: \"cbf9cb9b-ebff-4335-b709-aef600df008e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.261575 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.261496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:29:49.399339 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.399307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp"] Jun 09 15:29:49.401354 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:29:49.401328 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9cb9b_ebff_4335_b709_aef600df008e.slice/crio-e91fe99208c89ed6353783b558a34d345d7e28507ffbb4090ae81257d615403d WatchSource:0}: Error finding container e91fe99208c89ed6353783b558a34d345d7e28507ffbb4090ae81257d615403d: Status 404 returned error can't find the container with id e91fe99208c89ed6353783b558a34d345d7e28507ffbb4090ae81257d615403d Jun 09 15:29:49.704470 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.704431 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" event={"ID":"cbf9cb9b-ebff-4335-b709-aef600df008e","Type":"ContainerStarted","Data":"ed771dd81605a78a70df35e9c82b36a74b10d12e5ff438b7462af8a4a89a1a6e"} Jun 09 15:29:49.704641 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.704494 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" event={"ID":"cbf9cb9b-ebff-4335-b709-aef600df008e","Type":"ContainerStarted","Data":"e91fe99208c89ed6353783b558a34d345d7e28507ffbb4090ae81257d615403d"} Jun 09 15:29:49.721011 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:29:49.720983 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7" Jun 09 15:30:24.884890 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:24.884856 2566 generic.go:356] "Generic (PLEG): container finished" podID="1999fbed-f11c-4189-8120-20005ce3b9b6" containerID="2aead2cdb52d9471e23152998c41a79b3168f7bb99276bc761dcc816ffa5c774" exitCode=1 Jun 09 15:30:24.885365 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:24.884943 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerDied","Data":"2aead2cdb52d9471e23152998c41a79b3168f7bb99276bc761dcc816ffa5c774"} Jun 09 15:30:24.885365 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:24.885282 2566 scope.go:117] "RemoveContainer" containerID="2aead2cdb52d9471e23152998c41a79b3168f7bb99276bc761dcc816ffa5c774" Jun 09 15:30:25.211864 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:25.211820 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:30:25.892465 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:25.892429 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80"} Jun 09 15:30:25.892922 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:25.892536 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:30:36.899596 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:30:36.899565 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:31:34.234580 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:34.234545 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbf9cb9b-ebff-4335-b709-aef600df008e" containerID="ed771dd81605a78a70df35e9c82b36a74b10d12e5ff438b7462af8a4a89a1a6e" exitCode=0 Jun 09 15:31:34.235053 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:34.234612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" event={"ID":"cbf9cb9b-ebff-4335-b709-aef600df008e","Type":"ContainerDied","Data":"ed771dd81605a78a70df35e9c82b36a74b10d12e5ff438b7462af8a4a89a1a6e"} Jun 09 15:31:34.235306 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:34.235292 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:31:35.242041 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:35.242009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" event={"ID":"cbf9cb9b-ebff-4335-b709-aef600df008e","Type":"ContainerStarted","Data":"6ae8f0270199d5ed00cd6faea8ac8e5c7f594b7afeed7799f55c9bcefb8e9016"} Jun 09 15:31:35.263814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:35.263758 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" podStartSLOduration=2.6634641869999998 podStartE2EDuration="1m47.263738818s" totalImagesPullingTime="300.333298ms" totalInitContainerRuntime="1m44.299941333s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:31:35.263335998 +0000 UTC m=+1050.071094907" watchObservedRunningTime="2026-06-09 15:31:35.263738818 +0000 UTC m=+1050.071497728" Jun 09 15:31:39.261689 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:39.261651 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:31:39.262196 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:39.261738 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:31:39.274095 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:39.274072 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:31:40.277774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:31:40.277748 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zsplp" Jun 09 15:32:25.502341 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:25.502306 2566 generic.go:356] "Generic (PLEG): container finished" podID="1999fbed-f11c-4189-8120-20005ce3b9b6" containerID="05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80" exitCode=1 Jun 09 15:32:25.502854 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:25.502379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerDied","Data":"05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80"} Jun 09 15:32:25.502854 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:25.502471 2566 scope.go:117] "RemoveContainer" containerID="2aead2cdb52d9471e23152998c41a79b3168f7bb99276bc761dcc816ffa5c774" Jun 09 15:32:25.502854 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:25.502811 2566 scope.go:117] "RemoveContainer" containerID="05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80" Jun 09 15:32:25.503099 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:32:25.503076 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:32:26.898146 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:26.898107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:32:26.898665 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:26.898443 2566 scope.go:117] "RemoveContainer" containerID="05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80" Jun 09 15:32:26.898748 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:32:26.898689 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:32:39.681801 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:39.681761 2566 scope.go:117] "RemoveContainer" containerID="05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80" Jun 09 15:32:40.586528 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:40.586495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80"} Jun 09 15:32:40.586737 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:40.586721 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:32:51.593538 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:32:51.593504 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:34:05.729261 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:05.729228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:34:05.732596 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:05.732577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpxjc_4dd834e1-653d-4b9f-8dbd-44d275786efd/ovn-acl-logging/0.log" Jun 09 15:34:20.062667 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.062632 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:34:20.063183 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.062887 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" podUID="b990fc83-d59b-4418-af2b-25b67cd1b174" containerName="manager" containerID="cri-o://140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00" gracePeriod=30 Jun 09 15:34:20.316079 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.316009 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:34:20.380865 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.380827 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qj4b\" (UniqueName: \"kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b\") pod \"b990fc83-d59b-4418-af2b-25b67cd1b174\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " Jun 09 15:34:20.381043 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.380939 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert\") pod \"b990fc83-d59b-4418-af2b-25b67cd1b174\" (UID: \"b990fc83-d59b-4418-af2b-25b67cd1b174\") " Jun 09 15:34:20.383017 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.382980 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b990fc83-d59b-4418-af2b-25b67cd1b174" (UID: "b990fc83-d59b-4418-af2b-25b67cd1b174"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:34:20.383156 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.383040 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b" (OuterVolumeSpecName: "kube-api-access-8qj4b") pod "b990fc83-d59b-4418-af2b-25b67cd1b174" (UID: "b990fc83-d59b-4418-af2b-25b67cd1b174"). InnerVolumeSpecName "kube-api-access-8qj4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:34:20.482491 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.482450 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qj4b\" (UniqueName: \"kubernetes.io/projected/b990fc83-d59b-4418-af2b-25b67cd1b174-kube-api-access-8qj4b\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:34:20.482491 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:20.482488 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b990fc83-d59b-4418-af2b-25b67cd1b174-webhook-cert\") on node \"ip-10-0-132-252.ec2.internal\" DevicePath \"\"" Jun 09 15:34:21.102634 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.102597 2566 generic.go:356] "Generic (PLEG): container finished" podID="b990fc83-d59b-4418-af2b-25b67cd1b174" containerID="140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00" exitCode=0 Jun 09 15:34:21.103215 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.102641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" event={"ID":"b990fc83-d59b-4418-af2b-25b67cd1b174","Type":"ContainerDied","Data":"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00"} Jun 09 15:34:21.103215 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.102689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" event={"ID":"b990fc83-d59b-4418-af2b-25b67cd1b174","Type":"ContainerDied","Data":"70963ca35c467683172e0e4acef4b53dba7070c522812a631ebef1565e87f679"} Jun 09 15:34:21.103215 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.102720 2566 scope.go:117] "RemoveContainer" containerID="140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00" Jun 09 15:34:21.103215 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.103208 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-bpgrj" Jun 09 15:34:21.112412 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.112389 2566 scope.go:117] "RemoveContainer" containerID="140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00" Jun 09 15:34:21.112712 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:34:21.112685 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00\": container with ID starting with 140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00 not found: ID does not exist" containerID="140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00" Jun 09 15:34:21.112774 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.112729 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00"} err="failed to get container status \"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00\": rpc error: code = NotFound desc = could not find container \"140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00\": container with ID starting with 140f9f9ec0f12139c92228d600a583720ec168d554523eb0189c3cddb50b4b00 not found: ID does not exist" Jun 09 15:34:21.129688 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.129657 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:34:21.131572 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.131537 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-bpgrj"] Jun 09 15:34:21.688418 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.688386 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b990fc83-d59b-4418-af2b-25b67cd1b174" path="/var/lib/kubelet/pods/b990fc83-d59b-4418-af2b-25b67cd1b174/volumes" Jun 09 15:34:21.923256 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.923216 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9fd8f779b-lsxw2"] Jun 09 15:34:21.923648 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.923635 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b990fc83-d59b-4418-af2b-25b67cd1b174" containerName="manager" Jun 09 15:34:21.923695 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.923650 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b990fc83-d59b-4418-af2b-25b67cd1b174" containerName="manager" Jun 09 15:34:21.923734 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.923716 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b990fc83-d59b-4418-af2b-25b67cd1b174" containerName="manager" Jun 09 15:34:21.928291 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.928274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:21.932310 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.932276 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qclx9\"" Jun 09 15:34:21.932310 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.932293 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 15:34:21.932310 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.932296 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 15:34:21.936788 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.936768 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-lsxw2"] Jun 09 15:34:21.995406 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.995319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-webhook-cert\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:21.995406 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:21.995373 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbtf\" (UniqueName: \"kubernetes.io/projected/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-kube-api-access-wqbtf\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.095859 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.095821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbtf\" (UniqueName: \"kubernetes.io/projected/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-kube-api-access-wqbtf\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.096058 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.095962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-webhook-cert\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.098453 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.098425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-webhook-cert\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.105160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.105134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbtf\" (UniqueName: \"kubernetes.io/projected/9ded9b67-97a7-4702-a2e5-2ab08006cd2e-kube-api-access-wqbtf\") pod \"maas-controller-9fd8f779b-lsxw2\" (UID: \"9ded9b67-97a7-4702-a2e5-2ab08006cd2e\") " pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.239198 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.239162 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:22.382042 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:22.382015 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9fd8f779b-lsxw2"] Jun 09 15:34:22.383821 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:34:22.383792 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ded9b67_97a7_4702_a2e5_2ab08006cd2e.slice/crio-65d94831679aed6a21fbaad1e30be6bf6e12b02be4923047c34ea9c99e612d3f WatchSource:0}: Error finding container 65d94831679aed6a21fbaad1e30be6bf6e12b02be4923047c34ea9c99e612d3f: Status 404 returned error can't find the container with id 65d94831679aed6a21fbaad1e30be6bf6e12b02be4923047c34ea9c99e612d3f Jun 09 15:34:23.116535 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:23.116443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" event={"ID":"9ded9b67-97a7-4702-a2e5-2ab08006cd2e","Type":"ContainerStarted","Data":"df1ec22594cd20e96ab79e16c046be787b256f4f120dddd448c4298904fc47e6"} Jun 09 15:34:23.116535 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:23.116505 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:23.116535 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:23.116525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" event={"ID":"9ded9b67-97a7-4702-a2e5-2ab08006cd2e","Type":"ContainerStarted","Data":"65d94831679aed6a21fbaad1e30be6bf6e12b02be4923047c34ea9c99e612d3f"} Jun 09 15:34:23.137193 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:23.137134 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" podStartSLOduration=1.661439128 podStartE2EDuration="2.137112934s" totalImagesPullingTime="475.673806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:34:23.135052307 +0000 UTC m=+1217.942811217" watchObservedRunningTime="2026-06-09 15:34:23.137112934 +0000 UTC m=+1217.944871842" Jun 09 15:34:34.127885 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:34.127851 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9fd8f779b-lsxw2" Jun 09 15:34:40.204337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:40.204302 2566 generic.go:356] "Generic (PLEG): container finished" podID="1999fbed-f11c-4189-8120-20005ce3b9b6" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" exitCode=1 Jun 09 15:34:40.204808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:40.204374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerDied","Data":"99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80"} Jun 09 15:34:40.204808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:40.204437 2566 scope.go:117] "RemoveContainer" containerID="05b5164c59155bea915906ebb309ba5ee6f5d4166a58d4adedd13512ef6e3b80" Jun 09 15:34:40.204808 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:40.204729 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:34:40.204998 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:34:40.204958 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:34:41.521857 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:41.521819 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:34:41.522307 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:41.522180 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:34:41.522410 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:34:41.522391 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:34:41.591867 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:41.591833 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:34:42.218137 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:42.218103 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:34:42.218535 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:34:42.218490 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:34:54.681363 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:34:54.681324 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:34:54.681843 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:34:54.681614 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:35:06.681217 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:35:06.681186 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:35:07.344399 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:35:07.344361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f"} Jun 09 15:35:07.344586 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:35:07.344576 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:35:18.352359 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:35:18.352326 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:37:06.954312 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:06.954280 2566 generic.go:356] "Generic (PLEG): container finished" podID="1999fbed-f11c-4189-8120-20005ce3b9b6" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" exitCode=1 Jun 09 15:37:06.954757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:06.954326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerDied","Data":"9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f"} Jun 09 15:37:06.954757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:06.954382 2566 scope.go:117] "RemoveContainer" containerID="99ab4131452c74c3f9a6aa9d17d437b674c33f972e370fca55ef4658cf61df80" Jun 09 15:37:06.954757 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:06.954667 2566 scope.go:117] "RemoveContainer" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" Jun 09 15:37:06.954975 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:37:06.954956 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:37:08.351572 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:08.351528 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:37:08.352039 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:08.351861 2566 scope.go:117] "RemoveContainer" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" Jun 09 15:37:08.352144 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:37:08.352122 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:37:16.148364 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:16.148330 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dc9d488bd-mhscj_df7ac7a7-1207-4d3f-b01c-8a225478173a/nginx/0.log" Jun 09 15:37:16.500697 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:16.500614 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8499dc845d-5nllt_6aed4aaf-1974-4439-b025-7aaf879b22f4/maas-api/0.log" Jun 09 15:37:16.726011 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:16.725980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9fd8f779b-lsxw2_9ded9b67-97a7-4702-a2e5-2ab08006cd2e/manager/0.log" Jun 09 15:37:17.216785 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:17.216757 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-ftfvb_73f4700e-dae7-48d5-aa8b-d3511ab10209/copy-manifests/0.log" Jun 09 15:37:17.223869 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:17.223847 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-ftfvb_73f4700e-dae7-48d5-aa8b-d3511ab10209/manager/0.log" Jun 09 15:37:17.438341 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:17.438312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-gmkhf_c6525604-ac88-490b-beed-d19699b592d7/postgres/0.log" Jun 09 15:37:18.799003 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:18.798968 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-drjt5_3e423470-9a79-4733-87cd-03bc325f3d2f/manager/0.log" Jun 09 15:37:19.146150 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:19.146111 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zw2df_9c2daf54-1805-4c65-b15a-88c5dcf00dc9/registry-server/0.log" Jun 09 15:37:19.271798 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:19.271765 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8rj7r_dce8adee-1695-4c7a-8cad-9e5f40565de9/manager/0.log" Jun 09 15:37:19.843822 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:19.843792 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mq6n9_9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc/istio-proxy/0.log" Jun 09 15:37:20.290029 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:20.290000 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/1.log" Jun 09 15:37:20.405767 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:20.405742 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5sg5z_583f147c-2996-4e5e-b327-e898e36ac967/payload-pre-processing/0.log" Jun 09 15:37:20.529734 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:20.529699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log" Jun 09 15:37:21.086552 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.086521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-nkm7p_e0276954-9eae-4d13-8c63-05cf1bebdf01/storage-initializer/0.log" Jun 09 15:37:21.093624 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.093604 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-nkm7p_e0276954-9eae-4d13-8c63-05cf1bebdf01/main/0.log" Jun 09 15:37:21.234810 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.234777 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7_b152c183-324e-4cda-9e44-cae505002c30/storage-initializer/0.log" Jun 09 15:37:21.246964 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.246940 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vxpq7_b152c183-324e-4cda-9e44-cae505002c30/main/0.log" Jun 09 15:37:21.490938 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.490900 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-zsplp_cbf9cb9b-ebff-4335-b709-aef600df008e/storage-initializer/0.log" Jun 09 15:37:21.499997 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.499972 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-zsplp_cbf9cb9b-ebff-4335-b709-aef600df008e/main/0.log" Jun 09 15:37:21.521477 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.521443 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:37:21.521901 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:21.521886 2566 scope.go:117] "RemoveContainer" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" Jun 09 15:37:21.522175 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:37:21.522153 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:37:28.237370 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:28.237337 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r2lgj_ccd77cb7-4dc7-4092-a1f6-80bde2ca4237/global-pull-secret-syncer/0.log" Jun 09 15:37:28.314497 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:28.314465 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9wtck_60e01511-a4ea-47cd-868e-e3776e149c9c/konnectivity-agent/0.log" Jun 09 15:37:28.419406 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:28.419378 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-252.ec2.internal_dfb6445305ea38939422cb2d303894d8/haproxy/0.log" Jun 09 15:37:33.392212 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:33.392179 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-drjt5_3e423470-9a79-4733-87cd-03bc325f3d2f/manager/0.log" Jun 09 15:37:33.501249 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:33.501222 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zw2df_9c2daf54-1805-4c65-b15a-88c5dcf00dc9/registry-server/0.log" Jun 09 15:37:33.558598 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:33.558568 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8rj7r_dce8adee-1695-4c7a-8cad-9e5f40565de9/manager/0.log" Jun 09 15:37:35.590711 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.590676 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-r62gl_d8cd9214-292a-4834-a6da-9fa3071ffa35/monitoring-plugin/0.log" Jun 09 15:37:35.683053 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.683030 2566 scope.go:117] "RemoveContainer" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" Jun 09 15:37:35.683277 ip-10-0-132-252 kubenswrapper[2566]: E0609 15:37:35.683253 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-5rn92_openshift-ingress(1999fbed-f11c-4189-8120-20005ce3b9b6)\"" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" podUID="1999fbed-f11c-4189-8120-20005ce3b9b6" Jun 09 15:37:35.787570 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.787539 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgzw7_81ac1312-545f-4fcb-9a8b-37cba9adf196/node-exporter/0.log" Jun 09 15:37:35.804393 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.804371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgzw7_81ac1312-545f-4fcb-9a8b-37cba9adf196/kube-rbac-proxy/0.log" Jun 09 15:37:35.822961 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.822940 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgzw7_81ac1312-545f-4fcb-9a8b-37cba9adf196/init-textfile/0.log" Jun 09 15:37:35.947618 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.947533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/prometheus/0.log" Jun 09 15:37:35.969051 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.969028 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/config-reloader/0.log" Jun 09 15:37:35.987337 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:35.987314 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/thanos-sidecar/0.log" Jun 09 15:37:36.009595 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.009572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/kube-rbac-proxy-web/0.log" Jun 09 15:37:36.030130 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.030109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/kube-rbac-proxy/0.log" Jun 09 15:37:36.061661 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.061616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/kube-rbac-proxy-thanos/0.log" Jun 09 15:37:36.082574 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.082549 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a15d58-d1f7-4236-90be-057acff96b17/init-config-reloader/0.log" Jun 09 15:37:36.348915 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.348862 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/thanos-query/0.log" Jun 09 15:37:36.372218 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.372190 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/kube-rbac-proxy-web/0.log" Jun 09 15:37:36.394613 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.394588 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/kube-rbac-proxy/0.log" Jun 09 15:37:36.415542 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.415518 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/prom-label-proxy/0.log" Jun 09 15:37:36.436543 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.436521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/kube-rbac-proxy-rules/0.log" Jun 09 15:37:36.456156 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:36.456129 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f769d897b-wlsc4_728848d6-4aa5-412a-ba75-0b37f39865f4/kube-rbac-proxy-metrics/0.log" Jun 09 15:37:38.004563 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:38.004533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-8b5jr_2ac4a5f8-5567-4c75-a7ed-aee537c9b953/networking-console-plugin/0.log" Jun 09 15:37:39.767236 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.767206 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw"] Jun 09 15:37:39.770716 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.770694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.773309 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.773284 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"kube-root-ca.crt\"" Jun 09 15:37:39.774457 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.774435 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nbsh\"/\"default-dockercfg-5v85w\"" Jun 09 15:37:39.774575 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.774461 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"openshift-service-ca.crt\"" Jun 09 15:37:39.780622 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.780600 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw"] Jun 09 15:37:39.874902 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.874857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-lib-modules\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.875160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.874983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-sys\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.875160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.875073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-podres\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.875160 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.875114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-proc\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.875315 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.875288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4qm\" (UniqueName: \"kubernetes.io/projected/b08bcc0f-3e6a-43de-b64c-66616a5355b8-kube-api-access-kp4qm\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976022 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.975986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-podres\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976022 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-proc\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4qm\" (UniqueName: \"kubernetes.io/projected/b08bcc0f-3e6a-43de-b64c-66616a5355b8-kube-api-access-kp4qm\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-lib-modules\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-podres\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-proc\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-sys\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976294 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-sys\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.976491 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.976294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b08bcc0f-3e6a-43de-b64c-66616a5355b8-lib-modules\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:39.985557 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:39.985533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4qm\" (UniqueName: \"kubernetes.io/projected/b08bcc0f-3e6a-43de-b64c-66616a5355b8-kube-api-access-kp4qm\") pod \"perf-node-gather-daemonset-mrthw\" (UID: \"b08bcc0f-3e6a-43de-b64c-66616a5355b8\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:40.082630 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:40.082548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:40.216590 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:40.216568 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw"] Jun 09 15:37:40.218881 ip-10-0-132-252 kubenswrapper[2566]: W0609 15:37:40.218856 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb08bcc0f_3e6a_43de_b64c_66616a5355b8.slice/crio-dff00c74a9dc230c3b0e9a8b9f5fce6dde9906a60e43d153cdd152144489a9d5 WatchSource:0}: Error finding container dff00c74a9dc230c3b0e9a8b9f5fce6dde9906a60e43d153cdd152144489a9d5: Status 404 returned error can't find the container with id dff00c74a9dc230c3b0e9a8b9f5fce6dde9906a60e43d153cdd152144489a9d5 Jun 09 15:37:41.131286 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.131248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" event={"ID":"b08bcc0f-3e6a-43de-b64c-66616a5355b8","Type":"ContainerStarted","Data":"104862f797a53aa89045606b3e4a6e1a0f9e9f26fef8551fc45c2daabe7af856"} Jun 09 15:37:41.131730 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.131305 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" event={"ID":"b08bcc0f-3e6a-43de-b64c-66616a5355b8","Type":"ContainerStarted","Data":"dff00c74a9dc230c3b0e9a8b9f5fce6dde9906a60e43d153cdd152144489a9d5"} Jun 09 15:37:41.131730 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.131326 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:41.149881 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.149834 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" podStartSLOduration=2.1498191540000002 podStartE2EDuration="2.149819154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:37:41.147356428 +0000 UTC m=+1415.955115347" watchObservedRunningTime="2026-06-09 15:37:41.149819154 +0000 UTC m=+1415.957578063" Jun 09 15:37:41.239196 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.239164 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8hlqd_89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085/dns/0.log" Jun 09 15:37:41.259512 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.259475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8hlqd_89fa0eeb-1fcd-4ffd-9cfa-f2ebe577c085/kube-rbac-proxy/0.log" Jun 09 15:37:41.368321 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.368295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zbmdc_4889488a-3f1c-49a3-8ca4-8fe439dbb535/dns-node-resolver/0.log" Jun 09 15:37:41.983244 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:41.983220 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bl6s7_cf2d5220-8d65-417c-9bbd-e40c1507718e/node-ca/0.log" Jun 09 15:37:43.026389 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.026357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mq6n9_9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc/istio-proxy/0.log" Jun 09 15:37:43.175886 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.175859 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/0.log" Jun 09 15:37:43.184491 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.184463 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/1.log" Jun 09 15:37:43.213187 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.213157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5sg5z_583f147c-2996-4e5e-b327-e898e36ac967/payload-pre-processing/0.log" Jun 09 15:37:43.236493 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.236469 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log" Jun 09 15:37:43.236644 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.236599 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log" Jun 09 15:37:43.912591 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:43.912560 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7rz4p_a4e1ca5f-73be-4031-aae2-238f6fc401b3/serve-healthcheck-canary/0.log" Jun 09 15:37:44.438639 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:44.438605 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pp6sc_edecabf9-9a38-4937-bd9a-977114fac2b3/insights-operator/0.log" Jun 09 15:37:44.439071 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:44.438797 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pp6sc_edecabf9-9a38-4937-bd9a-977114fac2b3/insights-operator/1.log" Jun 09 15:37:44.461074 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:44.461054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxjz_b87d2656-dcca-4a6d-9f02-6e954e6857c5/kube-rbac-proxy/0.log" Jun 09 15:37:44.481786 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:44.481766 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxjz_b87d2656-dcca-4a6d-9f02-6e954e6857c5/exporter/0.log" Jun 09 15:37:44.505150 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:44.505124 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxjz_b87d2656-dcca-4a6d-9f02-6e954e6857c5/extractor/0.log" Jun 09 15:37:46.880972 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:46.880942 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dc9d488bd-mhscj_df7ac7a7-1207-4d3f-b01c-8a225478173a/nginx/0.log" Jun 09 15:37:46.998247 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:46.998174 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8499dc845d-5nllt_6aed4aaf-1974-4439-b025-7aaf879b22f4/maas-api/0.log" Jun 09 15:37:47.048677 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:47.048637 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9fd8f779b-lsxw2_9ded9b67-97a7-4702-a2e5-2ab08006cd2e/manager/0.log" Jun 09 15:37:47.147126 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:47.147099 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-mrthw" Jun 09 15:37:47.287640 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:47.287611 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-ftfvb_73f4700e-dae7-48d5-aa8b-d3511ab10209/manager/0.log" Jun 09 15:37:47.308032 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:47.308006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-ftfvb_73f4700e-dae7-48d5-aa8b-d3511ab10209/copy-manifests/0.log" Jun 09 15:37:47.386510 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:47.386480 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-gmkhf_c6525604-ac88-490b-beed-d19699b592d7/postgres/0.log" Jun 09 15:37:49.041037 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:49.040961 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-565556b8fb-5vggv_928d7eb1-ab12-4537-ab32-c035dea5cb7a/manager/0.log" Jun 09 15:37:49.681678 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:49.681651 2566 scope.go:117] "RemoveContainer" containerID="9afe0fc3ea88af8dfd8ffa42512341ae13c6175b2104aa7695c86b21471e656f" Jun 09 15:37:50.186686 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:50.186596 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" event={"ID":"1999fbed-f11c-4189-8120-20005ce3b9b6","Type":"ContainerStarted","Data":"c5481875b64a379fb6cac3065b198a4dae50a38c23ab9cf0a31ed7d71a1a0f8e"} Jun 09 15:37:50.187080 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:50.186847 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-5rn92" Jun 09 15:37:53.977305 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:53.977277 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mq6n9_9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc/istio-proxy/0.log" Jun 09 15:37:54.096895 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.096864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/0.log" Jun 09 15:37:54.105558 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.105535 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/1.log" Jun 09 15:37:54.126862 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.126837 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5sg5z_583f147c-2996-4e5e-b327-e898e36ac967/payload-pre-processing/0.log" Jun 09 15:37:54.137617 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.137588 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/4.log" Jun 09 15:37:54.140809 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.140789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log" Jun 09 15:37:54.585944 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.585918 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-46tv6_48f364c8-fe59-449e-a7d5-aa0031893e8b/migrator/0.log" Jun 09 15:37:54.605220 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:54.605194 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-46tv6_48f364c8-fe59-449e-a7d5-aa0031893e8b/graceful-termination/0.log" Jun 09 15:37:55.264078 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.264048 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mq6n9_9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc/istio-proxy/0.log" Jun 09 15:37:55.379444 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.379412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/0.log" Jun 09 15:37:55.387398 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.387377 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/1.log" Jun 09 15:37:55.407140 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.407104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5sg5z_583f147c-2996-4e5e-b327-e898e36ac967/payload-pre-processing/0.log" Jun 09 15:37:55.420706 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.420680 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/4.log" Jun 09 15:37:55.424954 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:55.424932 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log" Jun 09 15:37:56.175625 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.175597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/kube-multus-additional-cni-plugins/0.log" Jun 09 15:37:56.195134 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.195107 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/egress-router-binary-copy/0.log" Jun 09 15:37:56.222888 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.222866 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/cni-plugins/0.log" Jun 09 15:37:56.246122 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.246098 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/bond-cni-plugin/0.log" Jun 09 15:37:56.265756 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.265730 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/routeoverride-cni/0.log" Jun 09 15:37:56.284257 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.284233 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/whereabouts-cni-bincopy/0.log" Jun 09 15:37:56.305445 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.305422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9cjv_3758d68b-e5a7-4590-b678-a68239ccef32/whereabouts-cni/0.log" Jun 09 15:37:56.673837 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.673803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sc9j7_422044bf-f7f5-4813-8c67-6f7c273176d8/kube-multus/0.log" Jun 09 15:37:56.819636 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.819606 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vdllv_99f90c41-2169-4223-839f-c576cc1a5b03/network-metrics-daemon/0.log" Jun 09 15:37:56.839398 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:56.839375 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vdllv_99f90c41-2169-4223-839f-c576cc1a5b03/kube-rbac-proxy/0.log" Jun 09 15:37:57.010453 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.010371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mq6n9_9c2ffbcb-f6e1-4d32-9a15-9be1bb5317cc/istio-proxy/0.log" Jun 09 15:37:57.148475 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.148446 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/0.log" Jun 09 15:37:57.156333 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.156309 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-s6xbs_8efa912d-fd6f-4b50-a8c4-52747301cbe2/istio-proxy/1.log" Jun 09 15:37:57.178492 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.178472 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5sg5z_583f147c-2996-4e5e-b327-e898e36ac967/payload-pre-processing/0.log" Jun 09 15:37:57.193814 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.193794 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/4.log" Jun 09 15:37:57.196421 ip-10-0-132-252 kubenswrapper[2566]: I0609 15:37:57.196404 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-5rn92_1999fbed-f11c-4189-8120-20005ce3b9b6/payload-processing/3.log"