Jun 11 22:49:54.956507 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 22:49:54.956518 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 22:49:54.956526 ip-10-0-142-124 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 22:49:54.956777 ip-10-0-142-124 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 22:50:06.486110 ip-10-0-142-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 22:50:06.486126 ip-10-0-142-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b80f17d2bc0d4662a5e368b326fa52c7 -- Jun 11 22:52:35.242305 ip-10-0-142-124 systemd[1]: Starting Kubernetes Kubelet... Jun 11 22:52:35.655074 ip-10-0-142-124 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:35.655074 ip-10-0-142-124 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 22:52:35.655074 ip-10-0-142-124 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:35.655074 ip-10-0-142-124 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 22:52:35.655074 ip-10-0-142-124 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:35.655711 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.655109 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659859 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659887 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659895 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659901 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659905 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.659899 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659909 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659919 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659923 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659927 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659931 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659935 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659940 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659943 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659947 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659951 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659955 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659959 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659964 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659968 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659975 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659979 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659984 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659987 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659992 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.660275 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.659996 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660002 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660008 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660014 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660018 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660037 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660042 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660050 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660055 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660059 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660063 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660068 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660072 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660077 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660083 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660088 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660093 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660098 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660103 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660115 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.660894 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660120 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660125 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660130 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660135 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660139 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660144 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660148 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660153 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660158 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660163 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660167 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660172 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660181 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660185 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660190 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660194 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660198 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660203 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660207 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660212 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.661419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660217 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660221 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660226 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660232 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660242 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660247 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660252 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660257 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660262 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660269 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660274 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660278 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660283 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660288 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660294 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660299 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660309 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660314 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660318 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.661904 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660323 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660330 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660336 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660342 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660347 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660352 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660357 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660362 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660367 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660377 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660382 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660387 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660393 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660398 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660403 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.660408 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661555 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661567 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.662394 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661572 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661576 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661579 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661582 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661586 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661588 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661591 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661594 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661597 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661600 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661603 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661606 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661608 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661611 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661614 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661616 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661619 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661621 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661624 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661626 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.662863 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661629 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661631 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661634 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661637 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661640 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661642 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661645 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661648 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661650 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661653 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661656 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661659 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661662 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661665 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661669 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661672 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661675 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661678 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661681 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661683 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.663396 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661686 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661688 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661691 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661693 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661696 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661698 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661702 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661704 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661708 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661711 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661714 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661716 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661719 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661721 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661724 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661727 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661729 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661732 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661735 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661738 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.663900 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661740 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661743 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661746 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661749 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661751 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661754 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661757 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661759 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661762 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661764 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661767 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661769 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661772 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661775 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661778 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661781 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661783 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661786 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661789 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661791 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.664419 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661793 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661797 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661799 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661803 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661805 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661808 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661812 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661816 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661818 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661821 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661824 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661832 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661834 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661837 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661845 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661848 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.661850 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662255 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662261 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662264 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.664917 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662267 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662269 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662272 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662275 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662278 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662281 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662283 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662286 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662291 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662294 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662297 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662299 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662302 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662305 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662307 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662310 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662313 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662316 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662318 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.666143 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662321 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662324 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662326 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662329 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662331 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662334 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662338 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662342 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662345 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662347 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662350 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662352 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662355 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662358 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662361 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662366 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662371 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662374 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662377 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.666649 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662380 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662382 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662385 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662388 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662391 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662393 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662396 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662400 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662403 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662406 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662408 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662411 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662414 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662416 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662419 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662423 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662426 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662429 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662432 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662436 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.667167 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662440 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662442 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662445 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662448 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662451 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662453 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662456 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662459 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662461 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662464 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662466 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662469 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662472 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662474 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662477 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662479 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662482 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662484 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662487 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.667695 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662489 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662492 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662495 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662498 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662500 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662503 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662505 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662508 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662510 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662513 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662515 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662518 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662522 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662524 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662527 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662530 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662532 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.662535 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662618 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662626 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662634 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 22:52:35.668183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662640 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662645 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662649 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662653 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662657 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662661 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662663 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662667 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662670 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662673 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662677 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662680 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662682 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662686 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662689 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662694 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662697 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662700 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662703 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662707 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662710 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662714 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662717 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 22:52:35.668690 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662722 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662726 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662729 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662732 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662735 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662738 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662742 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662746 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662749 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662752 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662755 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662758 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662762 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662765 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662768 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662771 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662774 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662778 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662781 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662785 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662788 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662791 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662793 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662797 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662800 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 22:52:35.669332 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662803 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662805 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662808 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662812 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662815 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662818 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662821 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662825 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662830 2574 flags.go:64] FLAG: --help="false" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662833 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662836 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662839 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662842 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662845 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662848 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662851 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662854 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662857 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662860 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662862 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662865 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662868 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662871 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662874 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 22:52:35.669962 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662877 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662880 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662883 2574 flags.go:64] FLAG: --lock-file="" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662886 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662888 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662891 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662897 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662901 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662903 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662906 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662909 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662912 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662915 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662917 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662922 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662926 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662932 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662935 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662938 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662941 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662944 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662947 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662950 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662953 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662961 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 22:52:35.670578 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662964 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662967 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662970 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662973 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662979 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662982 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662985 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662988 2574 flags.go:64] FLAG: --port="10250" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662991 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662994 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af1508dadcc50227" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.662997 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663000 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663003 2574 flags.go:64] FLAG: --register-node="true" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663006 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663009 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663012 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663015 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663018 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663040 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663044 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663047 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663050 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663053 2574 flags.go:64] FLAG: --runonce="false" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663059 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663062 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 22:52:35.671201 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663065 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663068 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663071 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663074 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663077 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663080 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663083 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663086 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663089 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663092 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663095 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663098 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663101 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663106 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663109 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663112 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663117 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663120 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663123 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663125 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663128 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663131 2574 flags.go:64] FLAG: --v="2" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663135 2574 flags.go:64] FLAG: --version="false" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663139 2574 flags.go:64] FLAG: --vmodule="" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663143 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 22:52:35.671815 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663147 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663277 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663282 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663285 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663287 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663293 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663296 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663300 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663304 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663306 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663309 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663312 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663315 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663317 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663320 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663322 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663325 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663327 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663330 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.672541 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663332 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663336 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663338 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663341 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663344 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663346 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663349 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663351 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663354 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663356 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663359 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663362 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663365 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663367 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663370 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663373 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663375 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663378 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663383 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.673084 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663385 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663388 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663390 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663393 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663396 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663399 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663402 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663404 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663407 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663410 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663412 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663415 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663418 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663420 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663423 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663426 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663428 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663431 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663434 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663436 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.673554 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663439 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663441 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663444 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663446 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663449 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663451 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663454 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663458 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663461 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663464 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663467 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663475 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663478 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663480 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663483 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663485 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663488 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663490 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663493 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663496 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.674042 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663498 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663501 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663503 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663506 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663509 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663511 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663514 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663516 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663519 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663521 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663524 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663528 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663531 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663534 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663537 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663539 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663542 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663545 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663548 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.674535 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663551 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663554 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.663557 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.663566 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.670399 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.670416 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.670429 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.670435 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670497 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670502 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670506 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670510 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670515 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670518 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.674997 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670522 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670525 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670528 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670531 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670534 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670537 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670540 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670543 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670546 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670549 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670552 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670555 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670558 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670560 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670563 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670566 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670570 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670574 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670578 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.675366 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670581 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670583 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670586 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670589 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670592 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670595 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670598 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670600 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670603 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670606 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670608 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670611 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670614 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670616 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670619 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670622 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670625 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670628 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670631 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670633 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.675837 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670636 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670638 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670641 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670643 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670646 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670648 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670651 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670655 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670659 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670662 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670665 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670667 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670671 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670674 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670676 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670679 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670682 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670685 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670687 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670690 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.676324 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670693 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670695 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670698 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670700 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670703 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670706 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670708 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670711 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670713 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670716 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670718 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670721 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670723 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670726 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670728 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670731 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670734 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670736 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670739 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670742 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.676811 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670745 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670748 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670751 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670753 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670756 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670759 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670761 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670764 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670767 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670770 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670773 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670788 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670792 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670795 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.670800 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:35.677326 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670915 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670919 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670923 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670925 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670928 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670931 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670933 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670936 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670939 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670941 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670944 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670946 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670949 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670951 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670954 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670956 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670959 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670962 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670964 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670967 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:35.677691 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670970 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670972 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670975 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670978 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670981 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670984 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670987 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670989 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670992 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670994 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670997 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.670999 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671002 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671004 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671007 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671010 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671013 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671015 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671017 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671039 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:35.678316 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671043 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671045 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671048 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671053 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671057 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671060 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671063 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671067 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671070 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671073 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671077 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671080 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671083 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671086 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671089 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671092 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671095 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671099 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671102 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:35.678826 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671105 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671108 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671111 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671113 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671116 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671118 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671121 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671123 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671126 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671129 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671131 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671134 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671136 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671139 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671141 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671144 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671146 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671149 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671151 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671154 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:35.679685 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671156 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671159 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671161 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671164 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671168 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671171 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671174 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671176 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671179 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671182 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671186 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671189 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671191 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671194 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671196 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671199 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671202 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671204 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671207 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:35.680192 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:35.671210 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.671215 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.671334 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.673467 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.674904 2574 server.go:1019] "Starting client certificate rotation" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.675004 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.675829 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.678260 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 22:52:35.680655 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.679472 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 22:52:35.689470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.689452 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 22:52:35.692674 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.692657 2574 log.go:25] "Validated CRI v1 image API" Jun 11 22:52:35.693451 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.693436 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 22:52:35.697275 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.697255 2574 fs.go:135] Filesystem UUIDs: map[660bd7e3-9f54-4baf-af7c-76d368bf5540:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9656f0b5-1274-4806-9c9a-5e4d66a56d2e:/dev/nvme0n1p3] Jun 11 22:52:35.697318 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.697275 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 22:52:35.702954 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.702837 2574 manager.go:216] Machine: {Timestamp:2026-06-11 22:52:35.701307329 +0000 UTC m=+0.342292897 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094008 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26634b9b171a442159edb007252484 SystemUUID:ec26634b-9b17-1a44-2159-edb007252484 BootID:b80f17d2-bc0d-4662-a5e3-68b326fa52c7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:e9:29:c8:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:e9:29:c8:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:6c:d2:df:b5:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 22:52:35.702954 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.702949 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 22:52:35.703070 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.703051 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 22:52:35.705707 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.705692 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 22:52:35.706657 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.706634 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 22:52:35.706800 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.706662 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 22:52:35.707412 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.707402 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 22:52:35.707451 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.707415 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 22:52:35.707451 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.707423 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 22:52:35.708111 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.708101 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 22:52:35.709915 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.709904 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 22:52:35.712975 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.712955 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 22:52:35.713125 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713114 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 22:52:35.713156 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713146 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 22:52:35.713188 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713156 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 22:52:35.713188 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713168 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 22:52:35.713188 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713176 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 22:52:35.713188 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713186 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 22:52:35.713969 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713551 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 22:52:35.714037 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.713987 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 22:52:35.716369 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.716353 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 22:52:35.717825 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.717812 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 22:52:35.717886 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.717842 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 22:52:35.718010 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718000 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 22:52:35.718075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718015 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 22:52:35.718075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718038 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 22:52:35.718075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718044 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 22:52:35.718075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718053 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 22:52:35.718075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718059 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 22:52:35.718593 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718581 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 22:52:35.718624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718593 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 22:52:35.718624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718600 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 22:52:35.718624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718606 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 22:52:35.718624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718617 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 22:52:35.718624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.718625 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 22:52:35.720195 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.720185 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 22:52:35.720195 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.720195 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 22:52:35.723675 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.723662 2574 server.go:1268] "Started kubelet" Jun 11 22:52:35.723885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.723745 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 22:52:35.723885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.723757 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 22:52:35.724041 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.723856 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 22:52:35.724676 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.724645 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 22:52:35.724746 ip-10-0-142-124 systemd[1]: Started Kubernetes Kubelet. Jun 11 22:52:35.725086 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.725012 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 22:52:35.725181 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.725094 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 22:52:35.727862 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.727839 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 22:52:35.727958 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.727881 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krfrw" Jun 11 22:52:35.728892 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.728870 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 22:52:35.731445 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.731426 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 22:52:35.732711 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.731760 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-124.ec2.internal.18b828a840500b2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-124.ec2.internal,UID:ip-10-0-142-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-124.ec2.internal,},FirstTimestamp:2026-06-11 22:52:35.723635498 +0000 UTC m=+0.364621066,LastTimestamp:2026-06-11 22:52:35.723635498 +0000 UTC m=+0.364621066,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-124.ec2.internal,}" Jun 11 22:52:35.732919 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.732899 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 22:52:35.732919 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.732914 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 22:52:35.733109 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.733015 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:35.733708 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.733685 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 22:52:35.734427 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.734402 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 22:52:35.734427 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.734427 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 22:52:35.734604 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.734586 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 22:52:35.734604 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.734599 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 22:52:35.735190 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735064 2574 factory.go:55] Registering systemd factory Jun 11 22:52:35.735190 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735111 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 22:52:35.735520 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735507 2574 factory.go:153] Registering CRI-O factory Jun 11 22:52:35.735631 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735620 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 22:52:35.735761 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735743 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 22:52:35.735848 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735775 2574 factory.go:103] Registering Raw factory Jun 11 22:52:35.735848 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735794 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 22:52:35.736229 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.736214 2574 manager.go:349] Starting recovery of all containers Jun 11 22:52:35.737078 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.735772 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krfrw" Jun 11 22:52:35.743435 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.743262 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:35.745597 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.745561 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-124.ec2.internal\" not found" node="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.746485 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.746472 2574 manager.go:354] Recovery completed Jun 11 22:52:35.750918 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.750905 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.752895 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.752877 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.752985 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.752914 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.752985 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.752928 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.753652 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.753637 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 22:52:35.753652 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.753649 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 22:52:35.753780 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.753666 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 22:52:35.753780 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.753705 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.754772 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.754756 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.754836 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.754783 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.754836 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.754794 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.755004 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.754990 2574 policy_none.go:49] "None policy: Start" Jun 11 22:52:35.755050 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.755009 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 22:52:35.755050 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.755032 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 22:52:35.756117 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.756106 2574 policy_none.go:47] "Start" Jun 11 22:52:35.794925 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.794891 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.795667 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.795703 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.795713 2574 server.go:87] "Starting device plugin registration server" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.795998 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796067 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796146 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796178 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796198 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796220 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.796236 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796297 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.796305 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.797111 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.797165 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:35.800422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.798110 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:35.896429 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.896382 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.896627 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.896410 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal"] Jun 11 22:52:35.896627 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.896563 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.897629 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.897605 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.897753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.897636 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.897753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.897646 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.897753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.897670 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.898220 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.898204 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.898307 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.898232 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.898307 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.898242 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.899635 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.899621 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.899753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.899738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.899799 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.899774 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.900380 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900366 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.900470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900382 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.900470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900390 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.900470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900400 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.900470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900402 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.900470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.900411 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.901583 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.901569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.901648 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.901594 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:35.902232 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.902211 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:35.902316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.902239 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:35.902316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.902250 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:35.905145 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.905106 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.905145 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.905124 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-124.ec2.internal\": node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:35.919306 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.919278 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:35.919680 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.919666 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-124.ec2.internal\" not found" node="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.923867 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:35.923849 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-124.ec2.internal\" not found" node="ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.936193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.936171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.936295 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.936199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:35.936295 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:35.936218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf18cebe294061dc534d43c893c3b840-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"cf18cebe294061dc534d43c893c3b840\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.020392 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.020344 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.036781 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.036899 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.036899 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf18cebe294061dc534d43c893c3b840-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"cf18cebe294061dc534d43c893c3b840\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.036899 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf18cebe294061dc534d43c893c3b840-config\") pod \"kube-apiserver-proxy-ip-10-0-142-124.ec2.internal\" (UID: \"cf18cebe294061dc534d43c893c3b840\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.036899 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.037115 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.036872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8301d9841a175d22660c4f6fbdaa40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal\" (UID: \"c8301d9841a175d22660c4f6fbdaa40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.120939 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.120898 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.221632 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.221544 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.222648 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.222627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.227191 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.227173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:36.321976 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.321931 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.422431 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.422395 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.522925 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.522852 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.623349 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.623322 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.649578 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:36.649460 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf18cebe294061dc534d43c893c3b840.slice/crio-68cc63e11a62714f7e2f39b59fb0d0a69048c969483bb939e55e284e7d63f2c2 WatchSource:0}: Error finding container 68cc63e11a62714f7e2f39b59fb0d0a69048c969483bb939e55e284e7d63f2c2: Status 404 returned error can't find the container with id 68cc63e11a62714f7e2f39b59fb0d0a69048c969483bb939e55e284e7d63f2c2 Jun 11 22:52:36.649890 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:36.649856 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8301d9841a175d22660c4f6fbdaa40f.slice/crio-49ff9d85f8db7e49ff395ea32610604ebe724a9563831103f40b736796556e98 WatchSource:0}: Error finding container 49ff9d85f8db7e49ff395ea32610604ebe724a9563831103f40b736796556e98: Status 404 returned error can't find the container with id 49ff9d85f8db7e49ff395ea32610604ebe724a9563831103f40b736796556e98 Jun 11 22:52:36.654912 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.654897 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 22:52:36.674401 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.674377 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 22:52:36.674990 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.674473 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 22:52:36.674990 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.674477 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 22:52:36.723924 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.723878 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.742122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.742081 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 22:47:35 +0000 UTC" deadline="2028-01-14 23:15:01.544842466 +0000 UTC" Jun 11 22:52:36.742122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.742120 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13968h22m24.802726219s" Jun 11 22:52:36.800552 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.800463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" event={"ID":"cf18cebe294061dc534d43c893c3b840","Type":"ContainerStarted","Data":"68cc63e11a62714f7e2f39b59fb0d0a69048c969483bb939e55e284e7d63f2c2"} Jun 11 22:52:36.801535 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.801515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"c8301d9841a175d22660c4f6fbdaa40f","Type":"ContainerStarted","Data":"49ff9d85f8db7e49ff395ea32610604ebe724a9563831103f40b736796556e98"} Jun 11 22:52:36.815483 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:36.815465 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:36.824100 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.824079 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:36.924631 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:36.924592 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:37.025129 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.025085 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:37.125821 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.125672 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:37.226371 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.226337 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-124.ec2.internal\" not found" Jun 11 22:52:37.280098 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.280065 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:37.333277 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.333250 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" Jun 11 22:52:37.348193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.348162 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 22:52:37.349221 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.349192 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" Jun 11 22:52:37.361455 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.361419 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 22:52:37.679755 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.679731 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:37.713889 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.713857 2574 apiserver.go:52] "Watching apiserver" Jun 11 22:52:37.730279 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.730248 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 22:52:37.730674 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.730648 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-t468b","openshift-image-registry/node-ca-jt8sv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal","openshift-multus/multus-gghsb","kube-system/global-pull-secret-syncer-ntnjl","kube-system/konnectivity-agent-hxwh5","openshift-dns/node-resolver-hl8kw","openshift-multus/multus-additional-cni-plugins-5jxh9","openshift-multus/network-metrics-daemon-t5tdb","openshift-network-diagnostics/network-check-target-ln7b9","openshift-network-operator/iptables-alerter-2xxpd","openshift-ovn-kubernetes/ovnkube-node-2nrkc","kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc"] Jun 11 22:52:37.732450 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.732426 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:37.732566 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.732513 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:37.734374 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.734347 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 22:52:37.734837 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.734814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.736372 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.736351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.737821 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.737800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.739383 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.739362 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.739635 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.739618 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tqwqf\"" Jun 11 22:52:37.739790 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.739770 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 22:52:37.739866 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.739797 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 22:52:37.740000 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.739982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.740152 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.740121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:37.741333 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741174 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 22:52:37.741333 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741226 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.741333 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741276 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.741594 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.741594 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bqpvc\"" Jun 11 22:52:37.741594 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741514 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.741759 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741691 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.741829 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741790 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 22:52:37.741907 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741882 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.741977 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.741931 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 22:52:37.742231 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.742212 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 22:52:37.743661 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.743641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.745227 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-systemd-units\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745227 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.745227 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745413 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-env-overrides\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745413 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-kubelet\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745413 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745373 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-netns\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745413 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-systemd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-etc-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-ovn\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-node-log\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-bin\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-netd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.745668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-config\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e098e39-7dbc-464d-8281-afd561b9f583-ovn-node-metrics-cert\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-script-lib\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwd5z\" (UniqueName: \"kubernetes.io/projected/7e098e39-7dbc-464d-8281-afd561b9f583-kube-api-access-dwd5z\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-slash\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-var-lib-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-log-socket\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.746053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.745840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:37.746376 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.746276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnr7q\"" Jun 11 22:52:37.746442 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.746426 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 22:52:37.747073 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.747039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.747612 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.747597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.747788 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.747767 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:37.747975 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.747954 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.748091 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.747990 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 22:52:37.748334 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.748316 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 22:52:37.748631 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.748613 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 22:52:37.749139 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.749123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8d6nz\"" Jun 11 22:52:37.749403 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.749390 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.750580 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.750561 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nvwv5\"" Jun 11 22:52:37.750845 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.750830 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.752156 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.752136 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.753233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.753213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.756334 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.756282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7xp48\"" Jun 11 22:52:37.756836 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.756813 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.757077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.757059 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.757459 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.757392 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 22:52:37.757951 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.757927 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.758073 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.758050 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 22:52:37.758439 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.758397 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.758439 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.758407 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4qsxd\"" Jun 11 22:52:37.758858 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.758838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxbpc\"" Jun 11 22:52:37.759171 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.759120 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 22:52:37.759171 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.759166 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-855kt\"" Jun 11 22:52:37.761073 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.759504 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.761073 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.759846 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 22:52:37.796211 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.796187 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4dfv8" Jun 11 22:52:37.808334 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.808306 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4dfv8" Jun 11 22:52:37.834832 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.834801 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 22:52:37.846266 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-host\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-system-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846305 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cnibin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-ovn\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-script-lib\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846453 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-conf-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-ovn\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-run\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwd5z\" (UniqueName: \"kubernetes.io/projected/7e098e39-7dbc-464d-8281-afd561b9f583-kube-api-access-dwd5z\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r669\" (UniqueName: \"kubernetes.io/projected/d17bb9ff-7f34-4864-ad31-49a434929a5c-kube-api-access-5r669\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a5be60-4323-431c-8dc9-df6af9477bb7-host-slash\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-log-socket\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-multus\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-log-socket\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-conf\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.846720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-systemd\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-socket-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29a5be60-4323-431c-8dc9-df6af9477bb7-iptables-alerter-script\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cni-binary-copy\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvfvr\" (UniqueName: \"kubernetes.io/projected/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-kube-api-access-hvfvr\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-lib-modules\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-kubelet\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-bin\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e098e39-7dbc-464d-8281-afd561b9f583-ovn-node-metrics-cert\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-modprobe-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-kubelet\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-bin\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v297z\" (UniqueName: \"kubernetes.io/projected/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-kube-api-access-v297z\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.846982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-netd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-config\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847193 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-script-lib\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-cni-netd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-multus-certs\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-etc-kubernetes\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-registration-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-k8s-cni-cncf-io\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysconfig\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847198 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c00acbb-c757-4694-afca-3489ab3075ce-host\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-env-overrides\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17bb9ff-7f34-4864-ad31-49a434929a5c-tmp-dir\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4fc\" (UniqueName: \"kubernetes.io/projected/29a5be60-4323-431c-8dc9-df6af9477bb7-kube-api-access-kw4fc\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-etc-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-node-log\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.847973 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-etc-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d86772d4-1356-4d8b-b126-0b5070fa3a30-agent-certs\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17bb9ff-7f34-4864-ad31-49a434929a5c-hosts-file\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-node-log\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c00acbb-c757-4694-afca-3489ab3075ce-serviceca\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-ovnkube-config\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-948kb\" (UniqueName: \"kubernetes.io/projected/9c00acbb-c757-4694-afca-3489ab3075ce-kube-api-access-948kb\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-var-lib-kubelet\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-socket-dir-parent\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-kubelet\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-kubernetes\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-etc-selinux\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e098e39-7dbc-464d-8281-afd561b9f583-env-overrides\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-netns\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-daemon-config\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-tmp\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.848726 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-sys-fs\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-os-release\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-os-release\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.847997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-tuned\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-cnibin\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-netns\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-systemd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-run-netns\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-hostroot\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-sys\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-run-systemd\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d86772d4-1356-4d8b-b126-0b5070fa3a30-konnectivity-ca\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.849496 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjhr\" (UniqueName: \"kubernetes.io/projected/eb1e4f12-f689-4b12-8e6a-2128b82645b8-kube-api-access-zwjhr\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-slash\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-var-lib-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-host-slash\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-var-lib-openvswitch\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-systemd-units\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-bin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-kubelet-config\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-dbus\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e098e39-7dbc-464d-8281-afd561b9f583-systemd-units\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-device-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lffnm\" (UniqueName: \"kubernetes.io/projected/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kube-api-access-lffnm\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.850204 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.848869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kclv\" (UniqueName: \"kubernetes.io/projected/a82e2e68-9212-4aed-b15a-2806fa664a39-kube-api-access-8kclv\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.851106 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.851088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e098e39-7dbc-464d-8281-afd561b9f583-ovn-node-metrics-cert\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.855985 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.855959 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:37.855985 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.855988 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:37.856176 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.856002 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:37.856176 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.856098 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:52:38.356077185 +0000 UTC m=+2.997062746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:37.856405 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.856384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwd5z\" (UniqueName: \"kubernetes.io/projected/7e098e39-7dbc-464d-8281-afd561b9f583-kube-api-access-dwd5z\") pod \"ovnkube-node-2nrkc\" (UID: \"7e098e39-7dbc-464d-8281-afd561b9f583\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:37.886421 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.886384 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:37.949351 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-multus-certs\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949351 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-etc-kubernetes\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949602 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-registration-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.949602 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-etc-kubernetes\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949602 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-multus-certs\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949602 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-k8s-cni-cncf-io\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949601 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-registration-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysconfig\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-k8s-cni-cncf-io\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysconfig\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c00acbb-c757-4694-afca-3489ab3075ce-host\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c00acbb-c757-4694-afca-3489ab3075ce-host\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17bb9ff-7f34-4864-ad31-49a434929a5c-tmp-dir\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4fc\" (UniqueName: \"kubernetes.io/projected/29a5be60-4323-431c-8dc9-df6af9477bb7-kube-api-access-kw4fc\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.949841 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d86772d4-1356-4d8b-b126-0b5070fa3a30-agent-certs\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17bb9ff-7f34-4864-ad31-49a434929a5c-hosts-file\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c00acbb-c757-4694-afca-3489ab3075ce-serviceca\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-948kb\" (UniqueName: \"kubernetes.io/projected/9c00acbb-c757-4694-afca-3489ab3075ce-kube-api-access-948kb\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-var-lib-kubelet\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-socket-dir-parent\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-kubelet\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.949986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-kubernetes\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-etc-selinux\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-netns\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-daemon-config\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-tmp\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17bb9ff-7f34-4864-ad31-49a434929a5c-tmp-dir\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-sys-fs\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-os-release\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.950316 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-socket-dir-parent\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-os-release\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-tuned\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-cnibin\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-hostroot\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-sys\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d86772d4-1356-4d8b-b126-0b5070fa3a30-konnectivity-ca\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjhr\" (UniqueName: \"kubernetes.io/projected/eb1e4f12-f689-4b12-8e6a-2128b82645b8-kube-api-access-zwjhr\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-sys-fs\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-os-release\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-etc-selinux\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-kubernetes\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.950657 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:37.951077 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-bin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.950719 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:52:38.450699917 +0000 UTC m=+3.091685489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-kubelet-config\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-dbus\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-run-netns\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17bb9ff-7f34-4864-ad31-49a434929a5c-hosts-file\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-dbus\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950998 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951113 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-sys\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.951131 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-cnibin\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-os-release\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.951906 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-hostroot\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:37.951209 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:38.451188716 +0000 UTC m=+3.092174285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-var-lib-kubelet\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-device-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lffnm\" (UniqueName: \"kubernetes.io/projected/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kube-api-access-lffnm\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-kubelet-config\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kclv\" (UniqueName: \"kubernetes.io/projected/a82e2e68-9212-4aed-b15a-2806fa664a39-kube-api-access-8kclv\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c00acbb-c757-4694-afca-3489ab3075ce-serviceca\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951329 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-kubelet\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-host\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.950742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-bin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-device-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-daemon-config\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-system-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cnibin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-conf-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.952669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-run\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-host\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r669\" (UniqueName: \"kubernetes.io/projected/d17bb9ff-7f34-4864-ad31-49a434929a5c-kube-api-access-5r669\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a5be60-4323-431c-8dc9-df6af9477bb7-host-slash\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-multus\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-conf\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-systemd\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-socket-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82e2e68-9212-4aed-b15a-2806fa664a39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-system-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29a5be60-4323-431c-8dc9-df6af9477bb7-iptables-alerter-script\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cni-binary-copy\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-run\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cnibin\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvfvr\" (UniqueName: \"kubernetes.io/projected/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-kube-api-access-hvfvr\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a5be60-4323-431c-8dc9-df6af9477bb7-host-slash\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-lib-modules\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-modprobe-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.953311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v297z\" (UniqueName: \"kubernetes.io/projected/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-kube-api-access-v297z\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-lib-modules\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-cni-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-systemd\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.951983 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-multus-conf-dir\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952041 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-sysctl-conf\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-host-var-lib-cni-multus\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-modprobe-d\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1071fe28-e9c3-4d07-b3c9-87e1d559a422-socket-dir\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-cni-binary-copy\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a82e2e68-9212-4aed-b15a-2806fa664a39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.952447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d86772d4-1356-4d8b-b126-0b5070fa3a30-konnectivity-ca\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.954057 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.953105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29a5be60-4323-431c-8dc9-df6af9477bb7-iptables-alerter-script\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.954602 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.954540 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-etc-tuned\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.954759 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.954716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d86772d4-1356-4d8b-b126-0b5070fa3a30-agent-certs\") pod \"konnectivity-agent-hxwh5\" (UID: \"d86772d4-1356-4d8b-b126-0b5070fa3a30\") " pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:37.954939 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.954924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-tmp\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.961832 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.961802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-948kb\" (UniqueName: \"kubernetes.io/projected/9c00acbb-c757-4694-afca-3489ab3075ce-kube-api-access-948kb\") pod \"node-ca-jt8sv\" (UID: \"9c00acbb-c757-4694-afca-3489ab3075ce\") " pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:37.962221 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.962189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjhr\" (UniqueName: \"kubernetes.io/projected/eb1e4f12-f689-4b12-8e6a-2128b82645b8-kube-api-access-zwjhr\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:37.962785 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.962757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4fc\" (UniqueName: \"kubernetes.io/projected/29a5be60-4323-431c-8dc9-df6af9477bb7-kube-api-access-kw4fc\") pod \"iptables-alerter-2xxpd\" (UID: \"29a5be60-4323-431c-8dc9-df6af9477bb7\") " pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:37.964393 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.964362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvfvr\" (UniqueName: \"kubernetes.io/projected/b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43-kube-api-access-hvfvr\") pod \"multus-gghsb\" (UID: \"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43\") " pod="openshift-multus/multus-gghsb" Jun 11 22:52:37.964785 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.964754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kclv\" (UniqueName: \"kubernetes.io/projected/a82e2e68-9212-4aed-b15a-2806fa664a39-kube-api-access-8kclv\") pod \"multus-additional-cni-plugins-5jxh9\" (UID: \"a82e2e68-9212-4aed-b15a-2806fa664a39\") " pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:37.964864 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.964816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v297z\" (UniqueName: \"kubernetes.io/projected/5ad5aa71-e927-40f3-bb6e-73b6abb8a947-kube-api-access-v297z\") pod \"tuned-t468b\" (UID: \"5ad5aa71-e927-40f3-bb6e-73b6abb8a947\") " pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:37.965089 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.965074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lffnm\" (UniqueName: \"kubernetes.io/projected/1071fe28-e9c3-4d07-b3c9-87e1d559a422-kube-api-access-lffnm\") pod \"aws-ebs-csi-driver-node-9pxcc\" (UID: \"1071fe28-e9c3-4d07-b3c9-87e1d559a422\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:37.965168 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:37.965154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r669\" (UniqueName: \"kubernetes.io/projected/d17bb9ff-7f34-4864-ad31-49a434929a5c-kube-api-access-5r669\") pod \"node-resolver-hl8kw\" (UID: \"d17bb9ff-7f34-4864-ad31-49a434929a5c\") " pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:38.046812 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.046728 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:52:38.054493 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.054467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gghsb" Jun 11 22:52:38.064432 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.064413 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t468b" Jun 11 22:52:38.072387 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.072353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:52:38.080796 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.080773 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hl8kw" Jun 11 22:52:38.086645 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.086626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" Jun 11 22:52:38.093416 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.093394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xxpd" Jun 11 22:52:38.099944 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.099925 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jt8sv" Jun 11 22:52:38.105116 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.105097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" Jun 11 22:52:38.455059 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.454966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:38.455059 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.455015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:38.455059 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.455058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455137 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455174 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455181 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455199 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455211 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455214 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:52:39.455194958 +0000 UTC m=+4.096180525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455240 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:39.455230457 +0000 UTC m=+4.096216014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:38.455338 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:38.455257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:52:39.455246121 +0000 UTC m=+4.096231674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:38.542540 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.542497 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82e2e68_9212_4aed_b15a_2806fa664a39.slice/crio-27d77bf71b6a39f98dd206f5831f4577ccf97b069fb3cafa719694fab0fac1ca WatchSource:0}: Error finding container 27d77bf71b6a39f98dd206f5831f4577ccf97b069fb3cafa719694fab0fac1ca: Status 404 returned error can't find the container with id 27d77bf71b6a39f98dd206f5831f4577ccf97b069fb3cafa719694fab0fac1ca Jun 11 22:52:38.545528 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.545310 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c00acbb_c757_4694_afca_3489ab3075ce.slice/crio-6dfe723de03c70cc7e18710b3dfc759b88b4094739130e31100bc6438a78c040 WatchSource:0}: Error finding container 6dfe723de03c70cc7e18710b3dfc759b88b4094739130e31100bc6438a78c040: Status 404 returned error can't find the container with id 6dfe723de03c70cc7e18710b3dfc759b88b4094739130e31100bc6438a78c040 Jun 11 22:52:38.546168 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.546103 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad5aa71_e927_40f3_bb6e_73b6abb8a947.slice/crio-aa6689cf95d51171d0b4d382eb152e6affe563504a98217d56b1ffa19323a1c4 WatchSource:0}: Error finding container aa6689cf95d51171d0b4d382eb152e6affe563504a98217d56b1ffa19323a1c4: Status 404 returned error can't find the container with id aa6689cf95d51171d0b4d382eb152e6affe563504a98217d56b1ffa19323a1c4 Jun 11 22:52:38.550532 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.550451 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1071fe28_e9c3_4d07_b3c9_87e1d559a422.slice/crio-fc27d97b9a2a6963c7722efdfd8364c6654fb7cb6534144e1a51387d4f6629a8 WatchSource:0}: Error finding container fc27d97b9a2a6963c7722efdfd8364c6654fb7cb6534144e1a51387d4f6629a8: Status 404 returned error can't find the container with id fc27d97b9a2a6963c7722efdfd8364c6654fb7cb6534144e1a51387d4f6629a8 Jun 11 22:52:38.551380 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.551354 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e098e39_7dbc_464d_8281_afd561b9f583.slice/crio-e71f5a1eced3d9107b8af85e69d7df758612a9ece54d9a9eeec43b0c42362fc1 WatchSource:0}: Error finding container e71f5a1eced3d9107b8af85e69d7df758612a9ece54d9a9eeec43b0c42362fc1: Status 404 returned error can't find the container with id e71f5a1eced3d9107b8af85e69d7df758612a9ece54d9a9eeec43b0c42362fc1 Jun 11 22:52:38.552841 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.552812 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17bb9ff_7f34_4864_ad31_49a434929a5c.slice/crio-5bd7cd4e5d0cf8a4aa4fc63125d624719522ae746a9bc5cc40e10805d4445fda WatchSource:0}: Error finding container 5bd7cd4e5d0cf8a4aa4fc63125d624719522ae746a9bc5cc40e10805d4445fda: Status 404 returned error can't find the container with id 5bd7cd4e5d0cf8a4aa4fc63125d624719522ae746a9bc5cc40e10805d4445fda Jun 11 22:52:38.554519 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.554485 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86772d4_1356_4d8b_b126_0b5070fa3a30.slice/crio-d4e921cd583437428d3eafe3962fe954912edab130407b2887f73250c87fd009 WatchSource:0}: Error finding container d4e921cd583437428d3eafe3962fe954912edab130407b2887f73250c87fd009: Status 404 returned error can't find the container with id d4e921cd583437428d3eafe3962fe954912edab130407b2887f73250c87fd009 Jun 11 22:52:38.556145 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.555758 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a5be60_4323_431c_8dc9_df6af9477bb7.slice/crio-2c9230b6c9f8d45453c5e55a33946aedbc85e794edb283efa0b3737c59dec1d3 WatchSource:0}: Error finding container 2c9230b6c9f8d45453c5e55a33946aedbc85e794edb283efa0b3737c59dec1d3: Status 404 returned error can't find the container with id 2c9230b6c9f8d45453c5e55a33946aedbc85e794edb283efa0b3737c59dec1d3 Jun 11 22:52:38.556847 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:52:38.556690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92fc1aa_6b2a_4a4c_a4e4_b54b30b3dd43.slice/crio-8abf882b6f36536fd0348d754afa38e023abeda03be499e8174bb482edd6c485 WatchSource:0}: Error finding container 8abf882b6f36536fd0348d754afa38e023abeda03be499e8174bb482edd6c485: Status 404 returned error can't find the container with id 8abf882b6f36536fd0348d754afa38e023abeda03be499e8174bb482edd6c485 Jun 11 22:52:38.805730 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.805519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" event={"ID":"cf18cebe294061dc534d43c893c3b840","Type":"ContainerStarted","Data":"6928c3153e9845c745497c11417ad177f9211f81aa48427cce10b63cd36684c7"} Jun 11 22:52:38.806580 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.806556 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xxpd" event={"ID":"29a5be60-4323-431c-8dc9-df6af9477bb7","Type":"ContainerStarted","Data":"2c9230b6c9f8d45453c5e55a33946aedbc85e794edb283efa0b3737c59dec1d3"} Jun 11 22:52:38.807471 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.807451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxwh5" event={"ID":"d86772d4-1356-4d8b-b126-0b5070fa3a30","Type":"ContainerStarted","Data":"d4e921cd583437428d3eafe3962fe954912edab130407b2887f73250c87fd009"} Jun 11 22:52:38.808351 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.808328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hl8kw" event={"ID":"d17bb9ff-7f34-4864-ad31-49a434929a5c","Type":"ContainerStarted","Data":"5bd7cd4e5d0cf8a4aa4fc63125d624719522ae746a9bc5cc40e10805d4445fda"} Jun 11 22:52:38.809394 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.809373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"e71f5a1eced3d9107b8af85e69d7df758612a9ece54d9a9eeec43b0c42362fc1"} Jun 11 22:52:38.810434 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.810393 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 22:47:37 +0000 UTC" deadline="2028-03-16 10:34:29.555583974 +0000 UTC" Jun 11 22:52:38.810434 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.810433 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15443h41m50.745153107s" Jun 11 22:52:38.810557 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.810455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t468b" event={"ID":"5ad5aa71-e927-40f3-bb6e-73b6abb8a947","Type":"ContainerStarted","Data":"aa6689cf95d51171d0b4d382eb152e6affe563504a98217d56b1ffa19323a1c4"} Jun 11 22:52:38.811549 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.811523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" event={"ID":"1071fe28-e9c3-4d07-b3c9-87e1d559a422","Type":"ContainerStarted","Data":"fc27d97b9a2a6963c7722efdfd8364c6654fb7cb6534144e1a51387d4f6629a8"} Jun 11 22:52:38.812512 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.812492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jt8sv" event={"ID":"9c00acbb-c757-4694-afca-3489ab3075ce","Type":"ContainerStarted","Data":"6dfe723de03c70cc7e18710b3dfc759b88b4094739130e31100bc6438a78c040"} Jun 11 22:52:38.813781 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.813762 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"c8301d9841a175d22660c4f6fbdaa40f","Type":"ContainerStarted","Data":"f6b615d336294391a8356060063990f23b968d3749d0191e9b52b905e8338bdb"} Jun 11 22:52:38.814846 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.814826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gghsb" event={"ID":"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43","Type":"ContainerStarted","Data":"8abf882b6f36536fd0348d754afa38e023abeda03be499e8174bb482edd6c485"} Jun 11 22:52:38.815957 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.815925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerStarted","Data":"27d77bf71b6a39f98dd206f5831f4577ccf97b069fb3cafa719694fab0fac1ca"} Jun 11 22:52:38.823399 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:38.823360 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-124.ec2.internal" podStartSLOduration=1.8233503610000001 podStartE2EDuration="1.823350361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:38.823291625 +0000 UTC m=+3.464277202" watchObservedRunningTime="2026-06-11 22:52:38.823350361 +0000 UTC m=+3.464335936" Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.462811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.462873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.462901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463095 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463118 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463134 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463172 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463198 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:52:41.463179325 +0000 UTC m=+6.104164882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463240 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:52:41.46322078 +0000 UTC m=+6.104206349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463310 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:39.463595 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.463344 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:41.46333233 +0000 UTC m=+6.104317890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:39.796624 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.796549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:39.796785 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.796681 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:39.797060 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.797040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:39.797182 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.797154 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:39.797239 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.797220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:39.797340 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:39.797292 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:39.810703 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.810666 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 22:47:37 +0000 UTC" deadline="2028-02-14 01:23:19.644709832 +0000 UTC" Jun 11 22:52:39.810703 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.810700 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14690h30m39.83401351s" Jun 11 22:52:39.827143 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.826502 2574 generic.go:356] "Generic (PLEG): container finished" podID="c8301d9841a175d22660c4f6fbdaa40f" containerID="f6b615d336294391a8356060063990f23b968d3749d0191e9b52b905e8338bdb" exitCode=0 Jun 11 22:52:39.827143 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:39.827085 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"c8301d9841a175d22660c4f6fbdaa40f","Type":"ContainerDied","Data":"f6b615d336294391a8356060063990f23b968d3749d0191e9b52b905e8338bdb"} Jun 11 22:52:40.839033 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:40.838926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" event={"ID":"c8301d9841a175d22660c4f6fbdaa40f","Type":"ContainerStarted","Data":"d267ff9436142f99dd2c9e4d7fedc65f30146629ff36a711d4254035b0e4452e"} Jun 11 22:52:40.858377 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:40.858325 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-124.ec2.internal" podStartSLOduration=3.858305149 podStartE2EDuration="3.858305149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:40.857321893 +0000 UTC m=+5.498307495" watchObservedRunningTime="2026-06-11 22:52:40.858305149 +0000 UTC m=+5.499290727" Jun 11 22:52:41.483440 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.483399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:41.483628 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.483466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:41.483628 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.483496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:41.483736 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.483711 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:41.483736 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.483728 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:41.483837 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.483742 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:41.483837 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.483810 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:52:45.483792087 +0000 UTC m=+10.124777647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:41.484295 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.484254 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:41.484393 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.484306 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:52:45.48428996 +0000 UTC m=+10.125275518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:41.484393 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.484368 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:41.484505 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.484421 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:45.484388381 +0000 UTC m=+10.125373940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:41.796546 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.796404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:41.796719 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.796552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:41.797001 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.796966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:41.797133 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.797101 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:41.797198 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:41.797146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:41.797251 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:41.797215 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:43.797195 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:43.797156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:43.797638 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:43.797168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:43.797638 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:43.797292 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:43.797638 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:43.797387 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:43.797638 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:43.797458 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:43.797638 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:43.797537 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:45.516680 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.516639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.516689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.516736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516832 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516851 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516871 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516893 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:52:53.516884785 +0000 UTC m=+18.157870340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516907 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516920 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:53.516912884 +0000 UTC m=+18.157898437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:45.517148 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.516949 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:52:53.516934426 +0000 UTC m=+18.157919993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:45.800551 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.800525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:45.800697 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.800640 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:45.800764 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.800715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:45.800850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.800825 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:45.800902 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:45.800882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:45.800989 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:45.800968 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:47.797556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:47.797612 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:47.797556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:47.797699 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:47.797831 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:47.798122 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:47.797912 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:49.796718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:49.796631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:49.796718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:49.796625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:49.796718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:49.796691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:49.797243 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:49.796788 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:49.797243 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:49.796826 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:49.797243 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:49.796912 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:51.797424 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:51.797386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:51.797880 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:51.797386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:51.797880 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:51.797534 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:51.797880 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:51.797535 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:51.797880 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:51.797619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:51.797880 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:51.797674 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:53.582597 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.582508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:53.582597 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.582567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:53.582597 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.582592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582651 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582713 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582726 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582743 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582754 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:53:09.582700263 +0000 UTC m=+34.223685825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582783 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:09.582765136 +0000 UTC m=+34.223750691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:53.583117 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.582799 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:53:09.582790825 +0000 UTC m=+34.223776383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:53.796753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.796715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:53.796753 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.796749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:53.796959 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.796838 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:53.796959 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:53.796884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:53.796959 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.796892 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:53.796959 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:53.796956 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:55.797579 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:55.797548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:55.798004 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:55.797655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:55.798004 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:55.797753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:55.798004 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:55.797785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:55.798004 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:55.797897 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:55.798209 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:55.797999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:57.797395 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.797067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:57.797992 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:57.797490 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:57.797992 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.797098 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:57.797992 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:57.797557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:57.797992 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.797067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:57.797992 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:57.797760 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:57.874220 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.874146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t468b" event={"ID":"5ad5aa71-e927-40f3-bb6e-73b6abb8a947","Type":"ContainerStarted","Data":"1ffae4a7845a9b35bdf78cd3189dde3ce7af9714cdd45f0655288dc908a0b328"} Jun 11 22:52:57.876106 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.876074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" event={"ID":"1071fe28-e9c3-4d07-b3c9-87e1d559a422","Type":"ContainerStarted","Data":"6fe765937f28deeb6e6fa960b92e27e71ce8ac6b2f7768f078d4d9b5f1582a7f"} Jun 11 22:52:57.877686 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.877656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jt8sv" event={"ID":"9c00acbb-c757-4694-afca-3489ab3075ce","Type":"ContainerStarted","Data":"0f5848448cfa7584e9b2bc15fd1d6822aa5ffed8fe075685b3326c809ace4cf8"} Jun 11 22:52:57.879267 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.879233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gghsb" event={"ID":"b92fc1aa-6b2a-4a4c-a4e4-b54b30b3dd43","Type":"ContainerStarted","Data":"66fa4b1f6113fca765c100bf348b83e01c284bfb5efa98b419f529cb73d38465"} Jun 11 22:52:57.880720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.880699 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="9789f1d6ee7402f65d23fb73bd1d84617f82bd5e923bb5d4a3691b88c3e3a61a" exitCode=0 Jun 11 22:52:57.880819 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.880770 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"9789f1d6ee7402f65d23fb73bd1d84617f82bd5e923bb5d4a3691b88c3e3a61a"} Jun 11 22:52:57.882227 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.882201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxwh5" event={"ID":"d86772d4-1356-4d8b-b126-0b5070fa3a30","Type":"ContainerStarted","Data":"96dfbfc2fe45e08b4c8cf50dd1c967d25796f3f5a69b1d3521feddb2512ac059"} Jun 11 22:52:57.883725 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.883707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hl8kw" event={"ID":"d17bb9ff-7f34-4864-ad31-49a434929a5c","Type":"ContainerStarted","Data":"304caaa4c91b3bb5c2792655aa2e264ffb20effeecaac9b442e78acde29babdb"} Jun 11 22:52:57.886367 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886350 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:52:57.886694 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886672 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e098e39-7dbc-464d-8281-afd561b9f583" containerID="bc047c43e4fdebaacc1c5e23db277b2e2041558ca28b3f8539daa91279ec0e1a" exitCode=1 Jun 11 22:52:57.886788 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"9674bee5fbf1545f76adb4fd0037c3d92424f0c9f6ff1ae0aba0b8019e576d56"} Jun 11 22:52:57.886788 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886747 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"18ee43d238420e6de7cd791aec75686e20cc4623a426ba279db293eff9267b7f"} Jun 11 22:52:57.886788 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"7bba62cd5ad70c41b7c4121fef6bcb5bd0c1566cd3d4901d6136d0cbe784ec5f"} Jun 11 22:52:57.886900 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"552df7d137d5becc2de620258c72d96ea42112ded99288d293c5a4727cb11fa8"} Jun 11 22:52:57.886900 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerDied","Data":"bc047c43e4fdebaacc1c5e23db277b2e2041558ca28b3f8539daa91279ec0e1a"} Jun 11 22:52:57.886900 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.886858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"b84d13d736ccb4488e6e4b6fa69444cd02bf16951f30a68d1f0855dc95e9449f"} Jun 11 22:52:57.892426 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.892388 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t468b" podStartSLOduration=3.330262554 podStartE2EDuration="21.892375844s" totalImagesPullingTime="18.56211329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:57.892229771 +0000 UTC m=+22.533215347" watchObservedRunningTime="2026-06-11 22:52:57.892375844 +0000 UTC m=+22.533361420" Jun 11 22:52:57.925365 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.925321 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jt8sv" podStartSLOduration=3.376062606 podStartE2EDuration="21.92530668s" totalImagesPullingTime="18.549244074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:57.907227031 +0000 UTC m=+22.548212607" watchObservedRunningTime="2026-06-11 22:52:57.92530668 +0000 UTC m=+22.566292295" Jun 11 22:52:57.940743 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.940702 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gghsb" podStartSLOduration=3.350052824 podStartE2EDuration="21.940686423s" totalImagesPullingTime="18.590633599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:57.924958308 +0000 UTC m=+22.565943884" watchObservedRunningTime="2026-06-11 22:52:57.940686423 +0000 UTC m=+22.581671999" Jun 11 22:52:57.940878 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.940828 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxwh5" podStartSLOduration=7.168162496 podStartE2EDuration="21.940822444s" totalImagesPullingTime="14.772659948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:57.940573325 +0000 UTC m=+22.581558902" watchObservedRunningTime="2026-06-11 22:52:57.940822444 +0000 UTC m=+22.581808019" Jun 11 22:52:57.956592 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:57.956541 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hl8kw" podStartSLOduration=3.4137184019999998 podStartE2EDuration="21.956524361s" totalImagesPullingTime="18.542805959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:57.956209029 +0000 UTC m=+22.597194605" watchObservedRunningTime="2026-06-11 22:52:57.956524361 +0000 UTC m=+22.597509939" Jun 11 22:52:58.542318 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.542284 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 22:52:58.809454 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.809361 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T22:52:58.542306269Z","UUID":"60f53f33-f321-4170-9db9-2f0f520bd08f","Handler":null,"Name":"","Endpoint":""} Jun 11 22:52:58.810876 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.810858 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 22:52:58.810981 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.810891 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 22:52:58.890470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.890435 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" event={"ID":"1071fe28-e9c3-4d07-b3c9-87e1d559a422","Type":"ContainerStarted","Data":"1e1d447887b88ad3fca24e34aadc71f26357d92efd0d5077a039edd7d7d25fc7"} Jun 11 22:52:58.891943 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:58.891904 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xxpd" event={"ID":"29a5be60-4323-431c-8dc9-df6af9477bb7","Type":"ContainerStarted","Data":"1faf63a15b0ceaaf9eec394ca8b37188a16ed2386e8e7c9f19211e9299304a83"} Jun 11 22:52:59.796816 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.796778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:52:59.797065 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.796778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:52:59.797065 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.796780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:52:59.797065 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:59.796921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:52:59.797065 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:59.796999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:52:59.797297 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:52:59.797093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:52:59.896220 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.896187 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" event={"ID":"1071fe28-e9c3-4d07-b3c9-87e1d559a422","Type":"ContainerStarted","Data":"e7d17be89217a06c13b311e444914605f7d4729c6ffb29cf8259bb9b3ccee97b"} Jun 11 22:52:59.917363 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.917310 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2xxpd" podStartSLOduration=5.377140166 podStartE2EDuration="23.917293883s" totalImagesPullingTime="18.540153717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:58.908066483 +0000 UTC m=+23.549052060" watchObservedRunningTime="2026-06-11 22:52:59.917293883 +0000 UTC m=+24.558279458" Jun 11 22:52:59.917600 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:52:59.917569 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9pxcc" podStartSLOduration=3.244818457 podStartE2EDuration="23.917558152s" totalImagesPullingTime="20.672739695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:59.916904147 +0000 UTC m=+24.557889724" watchObservedRunningTime="2026-06-11 22:52:59.917558152 +0000 UTC m=+24.558543729" Jun 11 22:53:00.902491 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:00.902314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:53:00.903066 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:00.902962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"fc32bcb60124bc3d5e5dd80e8f7d698c2a37334e309e7ba9579841c444cdeaa7"} Jun 11 22:53:01.136435 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:01.136396 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:53:01.137313 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:01.137295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:53:01.796765 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:01.796721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:01.796956 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:01.796721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:01.796956 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:01.796873 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:01.796956 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:01.796721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:01.797129 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:01.796965 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:01.797129 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:01.797066 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:02.549358 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.549154 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:53:02.550020 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.549725 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxwh5" Jun 11 22:53:02.910809 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.910780 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:53:02.911170 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.911145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"81d3948c87e2caeda7c9e4f6b7262cbfa68346f2f94578a88ca92c8a2cea4607"} Jun 11 22:53:02.911473 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.911440 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:02.911700 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.911683 2574 scope.go:117] "RemoveContainer" containerID="bc047c43e4fdebaacc1c5e23db277b2e2041558ca28b3f8539daa91279ec0e1a" Jun 11 22:53:02.913079 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.913051 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="155dbc413506f5908c2eba58f664184029d564e66caf24df32f24076f7783d77" exitCode=0 Jun 11 22:53:02.913177 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.913136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"155dbc413506f5908c2eba58f664184029d564e66caf24df32f24076f7783d77"} Jun 11 22:53:02.927913 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:02.927893 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:03.167259 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.167171 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:03.796509 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.796476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:03.797015 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.796482 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:03.797015 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.796597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:03.797015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:03.796584 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:03.797015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:03.796693 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:03.797015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:03.796792 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:03.919393 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.919368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:53:03.919744 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.919713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" event={"ID":"7e098e39-7dbc-464d-8281-afd561b9f583","Type":"ContainerStarted","Data":"75875fe9e23b16ae648357875ba53c0ba6c1c255f0acaa941c0cb7ee50a76aba"} Jun 11 22:53:03.920269 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.920244 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:03.935198 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.935172 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:03.958559 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:03.958512 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" podStartSLOduration=10.342721643 podStartE2EDuration="28.958496702s" totalImagesPullingTime="18.615775059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:03.958197509 +0000 UTC m=+28.599183086" watchObservedRunningTime="2026-06-11 22:53:03.958496702 +0000 UTC m=+28.599482278" Jun 11 22:53:04.211685 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.211652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ln7b9"] Jun 11 22:53:04.211853 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.211757 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:04.211911 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:04.211866 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:04.212442 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.212422 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntnjl"] Jun 11 22:53:04.212510 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.212500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:04.212592 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:04.212575 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:04.214173 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.214148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5tdb"] Jun 11 22:53:04.214301 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.214263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:04.214391 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:04.214371 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:04.924220 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.924184 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="5040e73ff582695580a8c0ec094b29c1beb0e2491e7792c73bd3944f691941a7" exitCode=0 Jun 11 22:53:04.924654 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:04.924269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"5040e73ff582695580a8c0ec094b29c1beb0e2491e7792c73bd3944f691941a7"} Jun 11 22:53:05.798000 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:05.797963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:05.798209 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:05.798077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:05.798209 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:05.798124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:05.798209 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:05.798122 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:05.798379 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:05.798212 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:05.798379 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:05.798307 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:06.931388 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:06.931201 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="d97e1f039dfef0e8b8ca65ab8738176c1a910cb572f3bffa0f0de425af52ed9d" exitCode=0 Jun 11 22:53:06.931388 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:06.931285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"d97e1f039dfef0e8b8ca65ab8738176c1a910cb572f3bffa0f0de425af52ed9d"} Jun 11 22:53:07.797274 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:07.797234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:07.797463 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:07.797234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:07.797463 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:07.797364 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:07.797463 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:07.797383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:07.797644 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:07.797501 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:07.797644 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:07.797608 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:09.596838 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.596809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:09.596838 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.596842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.596895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.596996 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597085 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:41.597063298 +0000 UTC m=+66.238048853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597092 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597134 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret podName:3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a nodeName:}" failed. No retries permitted until 2026-06-11 22:53:41.597121158 +0000 UTC m=+66.238106716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret") pod "global-pull-secret-syncer-ntnjl" (UID: "3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597200 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597220 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597228 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rwzpp for pod openshift-network-diagnostics/network-check-target-ln7b9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:53:09.597532 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.597270 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp podName:e8cd0e6a-1ac8-40d4-92c4-464239860c2b nodeName:}" failed. No retries permitted until 2026-06-11 22:53:41.597257795 +0000 UTC m=+66.238243361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwzpp" (UniqueName: "kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp") pod "network-check-target-ln7b9" (UID: "e8cd0e6a-1ac8-40d4-92c4-464239860c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:53:09.796853 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.796806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:09.796853 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.796837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:09.797133 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:09.796806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:09.797133 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.796942 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntnjl" podUID="3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a" Jun 11 22:53:09.797133 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.797042 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:53:09.797133 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:09.797097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln7b9" podUID="e8cd0e6a-1ac8-40d4-92c4-464239860c2b" Jun 11 22:53:10.194728 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.194689 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-124.ec2.internal" event="NodeReady" Jun 11 22:53:10.194922 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.194849 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 22:53:10.238573 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.238529 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r8k6t"] Jun 11 22:53:10.241402 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.241372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.241551 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.241440 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n9cvs"] Jun 11 22:53:10.243291 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.243267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.244462 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.244284 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 22:53:10.244462 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.244355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9z2n\"" Jun 11 22:53:10.244669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.244593 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 22:53:10.246409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.246345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wbppm\"" Jun 11 22:53:10.246409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.246370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 22:53:10.246586 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.246369 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 22:53:10.246586 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.246441 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 22:53:10.250634 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.250610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8k6t"] Jun 11 22:53:10.254555 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.254532 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9cvs"] Jun 11 22:53:10.402289 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.402470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae410fb1-2876-44ab-8d38-c921292c6084-config-volume\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.402470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zr6v\" (UniqueName: \"kubernetes.io/projected/ae410fb1-2876-44ab-8d38-c921292c6084-kube-api-access-2zr6v\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.402470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae410fb1-2876-44ab-8d38-c921292c6084-tmp-dir\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.402470 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3dd3ec7-a97d-4605-beea-94558f91aacc-cert\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.402673 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.402485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqp5\" (UniqueName: \"kubernetes.io/projected/e3dd3ec7-a97d-4605-beea-94558f91aacc-kube-api-access-smqp5\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.503634 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.503634 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae410fb1-2876-44ab-8d38-c921292c6084-config-volume\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.503634 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zr6v\" (UniqueName: \"kubernetes.io/projected/ae410fb1-2876-44ab-8d38-c921292c6084-kube-api-access-2zr6v\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.503904 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae410fb1-2876-44ab-8d38-c921292c6084-tmp-dir\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.503904 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3dd3ec7-a97d-4605-beea-94558f91aacc-cert\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.503904 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.503707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqp5\" (UniqueName: \"kubernetes.io/projected/e3dd3ec7-a97d-4605-beea-94558f91aacc-kube-api-access-smqp5\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.503904 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:10.503719 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:10.503904 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:10.503817 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:11.003774246 +0000 UTC m=+35.644759817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:10.504080 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.504066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae410fb1-2876-44ab-8d38-c921292c6084-tmp-dir\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.504435 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.504404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae410fb1-2876-44ab-8d38-c921292c6084-config-volume\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.508840 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.508818 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3dd3ec7-a97d-4605-beea-94558f91aacc-cert\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.518408 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.518388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zr6v\" (UniqueName: \"kubernetes.io/projected/ae410fb1-2876-44ab-8d38-c921292c6084-kube-api-access-2zr6v\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:10.523696 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.523652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqp5\" (UniqueName: \"kubernetes.io/projected/e3dd3ec7-a97d-4605-beea-94558f91aacc-kube-api-access-smqp5\") pod \"ingress-canary-n9cvs\" (UID: \"e3dd3ec7-a97d-4605-beea-94558f91aacc\") " pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:10.563268 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:10.563232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9cvs" Jun 11 22:53:11.009394 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.009352 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:11.010149 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:11.009524 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:11.010149 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:11.009604 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:12.00958222 +0000 UTC m=+36.650567793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:11.201733 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.201587 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9cvs"] Jun 11 22:53:11.204410 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:53:11.204386 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3dd3ec7_a97d_4605_beea_94558f91aacc.slice/crio-36e1366fe6a84260fb2f1fa38e8650c91b2459bd74c1ca106c2786168a483424 WatchSource:0}: Error finding container 36e1366fe6a84260fb2f1fa38e8650c91b2459bd74c1ca106c2786168a483424: Status 404 returned error can't find the container with id 36e1366fe6a84260fb2f1fa38e8650c91b2459bd74c1ca106c2786168a483424 Jun 11 22:53:11.797138 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.797102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:11.797327 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.797105 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:11.797327 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.797105 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:11.802345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802136 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mdrn\"" Jun 11 22:53:11.802533 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 22:53:11.802533 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s94r6\"" Jun 11 22:53:11.802533 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 22:53:11.802533 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802469 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 22:53:11.802894 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.802752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 22:53:11.945521 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.945487 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="9a906c6bd0784ed4ae117c35a8269b86a523968657c8f8e2e66b7c85fa390995" exitCode=0 Jun 11 22:53:11.945687 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.945566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"9a906c6bd0784ed4ae117c35a8269b86a523968657c8f8e2e66b7c85fa390995"} Jun 11 22:53:11.946725 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:11.946706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9cvs" event={"ID":"e3dd3ec7-a97d-4605-beea-94558f91aacc","Type":"ContainerStarted","Data":"36e1366fe6a84260fb2f1fa38e8650c91b2459bd74c1ca106c2786168a483424"} Jun 11 22:53:12.016975 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:12.016947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:12.017367 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:12.017127 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:12.017367 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:12.017187 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:14.017172065 +0000 UTC m=+38.658157618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:12.951836 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:12.951807 2574 generic.go:356] "Generic (PLEG): container finished" podID="a82e2e68-9212-4aed-b15a-2806fa664a39" containerID="79739104b545b5c6cadba775a1d6cbf623f2afc2fd2d9dfe833f0da2c0ee7478" exitCode=0 Jun 11 22:53:12.951927 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:12.951854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerDied","Data":"79739104b545b5c6cadba775a1d6cbf623f2afc2fd2d9dfe833f0da2c0ee7478"} Jun 11 22:53:13.955916 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:13.955719 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9cvs" event={"ID":"e3dd3ec7-a97d-4605-beea-94558f91aacc","Type":"ContainerStarted","Data":"1af9b70a770334a36e9f7bdec4e71fec4007b001b929795f08666f80322b1495"} Jun 11 22:53:13.958946 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:13.958917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" event={"ID":"a82e2e68-9212-4aed-b15a-2806fa664a39","Type":"ContainerStarted","Data":"a1aece544e6cc273ac018bba6e0541493b8e0a256ba7955a8e7543e028523521"} Jun 11 22:53:13.973173 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:13.973130 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n9cvs" podStartSLOduration=2.235904765 podStartE2EDuration="3.973113501s" totalImagesPullingTime="1.737208736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:13.972345013 +0000 UTC m=+38.613330590" watchObservedRunningTime="2026-06-11 22:53:13.973113501 +0000 UTC m=+38.614099078" Jun 11 22:53:13.996794 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:13.996752 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5jxh9" podStartSLOduration=8.883718396 podStartE2EDuration="37.996737033s" totalImagesPullingTime="29.113018637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:13.99504603 +0000 UTC m=+38.636031600" watchObservedRunningTime="2026-06-11 22:53:13.996737033 +0000 UTC m=+38.637722609" Jun 11 22:53:14.032943 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:14.032857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:14.033078 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:14.033041 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:14.033120 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:14.033108 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:18.033092543 +0000 UTC m=+42.674078096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:18.059668 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:18.059627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:18.060275 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:18.059805 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:18.060275 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:18.059892 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:26.059871016 +0000 UTC m=+50.700856589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:26.111400 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:26.111368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:26.111893 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:26.111478 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:26.111893 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:26.111560 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:42.111543474 +0000 UTC m=+66.752529042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:27.306519 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.306487 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6"] Jun 11 22:53:27.339066 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.339006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6"] Jun 11 22:53:27.339246 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.339148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.342324 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.342292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 22:53:27.342480 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.342463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 22:53:27.342542 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.342468 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 22:53:27.344130 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.344113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 22:53:27.344130 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.344114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-f86xf\"" Jun 11 22:53:27.522927 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.522887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6xw\" (UniqueName: \"kubernetes.io/projected/cc9e5861-8597-4c74-a671-5c045b497d8a-kube-api-access-6v6xw\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.523090 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.522956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc9e5861-8597-4c74-a671-5c045b497d8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.624309 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.624242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6xw\" (UniqueName: \"kubernetes.io/projected/cc9e5861-8597-4c74-a671-5c045b497d8a-kube-api-access-6v6xw\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.624423 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.624312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc9e5861-8597-4c74-a671-5c045b497d8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.628376 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.628353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc9e5861-8597-4c74-a671-5c045b497d8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.634601 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.634581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6xw\" (UniqueName: \"kubernetes.io/projected/cc9e5861-8597-4c74-a671-5c045b497d8a-kube-api-access-6v6xw\") pod \"managed-serviceaccount-addon-agent-5dc6699fd4-pprb6\" (UID: \"cc9e5861-8597-4c74-a671-5c045b497d8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.661576 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.661554 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" Jun 11 22:53:27.789277 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.789241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6"] Jun 11 22:53:27.792237 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:53:27.792203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc9e5861_8597_4c74_a671_5c045b497d8a.slice/crio-b03fecdc77b6face45ad3c7639029fdb742d1518a55474433340dc1ddaa41bd4 WatchSource:0}: Error finding container b03fecdc77b6face45ad3c7639029fdb742d1518a55474433340dc1ddaa41bd4: Status 404 returned error can't find the container with id b03fecdc77b6face45ad3c7639029fdb742d1518a55474433340dc1ddaa41bd4 Jun 11 22:53:27.991342 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:27.991277 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" event={"ID":"cc9e5861-8597-4c74-a671-5c045b497d8a","Type":"ContainerStarted","Data":"b03fecdc77b6face45ad3c7639029fdb742d1518a55474433340dc1ddaa41bd4"} Jun 11 22:53:31.001118 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:31.001016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" event={"ID":"cc9e5861-8597-4c74-a671-5c045b497d8a","Type":"ContainerStarted","Data":"c633e6954eb2bfb10921a0b1dd362e39c72a83af799350b3041948b353bee1d4"} Jun 11 22:53:31.016877 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:31.016828 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" podStartSLOduration=1.077281105 podStartE2EDuration="4.016813721s" totalImagesPullingTime="2.939532616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:31.015891637 +0000 UTC m=+55.656877214" watchObservedRunningTime="2026-06-11 22:53:31.016813721 +0000 UTC m=+55.657799296" Jun 11 22:53:35.936431 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:35.936404 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nrkc" Jun 11 22:53:41.618177 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.618125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:53:41.618177 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.618179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:41.618700 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.618225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:41.621286 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.621265 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 22:53:41.621365 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.621315 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 22:53:41.621420 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.621403 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 22:53:41.628954 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:41.628932 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 22:53:41.629069 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:41.628998 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:54:45.628978211 +0000 UTC m=+130.269963772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : secret "metrics-daemon-secret" not found Jun 11 22:53:41.631060 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.631041 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a-original-pull-secret\") pod \"global-pull-secret-syncer-ntnjl\" (UID: \"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a\") " pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:41.631773 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.631755 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 22:53:41.641239 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.641220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzpp\" (UniqueName: \"kubernetes.io/projected/e8cd0e6a-1ac8-40d4-92c4-464239860c2b-kube-api-access-rwzpp\") pod \"network-check-target-ln7b9\" (UID: \"e8cd0e6a-1ac8-40d4-92c4-464239860c2b\") " pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:41.809801 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.809777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntnjl" Jun 11 22:53:41.819787 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.819766 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mdrn\"" Jun 11 22:53:41.827368 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.827342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:41.946006 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.945975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntnjl"] Jun 11 22:53:41.950280 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:53:41.950243 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f8b5c_6a22_4db8_b4d9_cedb63982c5a.slice/crio-aa27725c8163648aea084165ea9e25503ab0de88b239bbe0e7b5cdda7463182c WatchSource:0}: Error finding container aa27725c8163648aea084165ea9e25503ab0de88b239bbe0e7b5cdda7463182c: Status 404 returned error can't find the container with id aa27725c8163648aea084165ea9e25503ab0de88b239bbe0e7b5cdda7463182c Jun 11 22:53:41.970907 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:41.970884 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ln7b9"] Jun 11 22:53:41.973171 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:53:41.973147 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cd0e6a_1ac8_40d4_92c4_464239860c2b.slice/crio-b399f5715c0d397c2c56c8144bb37f9d33746ed922be40a13d38cab3cbd5d816 WatchSource:0}: Error finding container b399f5715c0d397c2c56c8144bb37f9d33746ed922be40a13d38cab3cbd5d816: Status 404 returned error can't find the container with id b399f5715c0d397c2c56c8144bb37f9d33746ed922be40a13d38cab3cbd5d816 Jun 11 22:53:42.028217 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:42.028191 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ln7b9" event={"ID":"e8cd0e6a-1ac8-40d4-92c4-464239860c2b","Type":"ContainerStarted","Data":"b399f5715c0d397c2c56c8144bb37f9d33746ed922be40a13d38cab3cbd5d816"} Jun 11 22:53:42.029291 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:42.029260 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntnjl" event={"ID":"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a","Type":"ContainerStarted","Data":"aa27725c8163648aea084165ea9e25503ab0de88b239bbe0e7b5cdda7463182c"} Jun 11 22:53:42.121361 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:42.121326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:53:42.121482 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:42.121464 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:42.121537 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:53:42.121527 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:54:14.121507958 +0000 UTC m=+98.762493512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:53:47.046502 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:47.046405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ln7b9" event={"ID":"e8cd0e6a-1ac8-40d4-92c4-464239860c2b","Type":"ContainerStarted","Data":"f649d722a41af09e99570a86012a66112424c7bed4182c4d8a88b1741ccd320e"} Jun 11 22:53:47.046942 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:47.046511 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:53:47.047951 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:47.047912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntnjl" event={"ID":"3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a","Type":"ContainerStarted","Data":"d96d701a8e6c1b713d0d8817e121fa12c5df9f8f2553f00041a8c8a5de5ffd57"} Jun 11 22:53:47.063783 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:47.063735 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ln7b9" podStartSLOduration=67.247227573 podStartE2EDuration="1m12.063722437s" totalImagesPullingTime="4.816494864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:47.062491914 +0000 UTC m=+71.703477489" watchObservedRunningTime="2026-06-11 22:53:47.063722437 +0000 UTC m=+71.704708013" Jun 11 22:53:47.078186 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:53:47.078145 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ntnjl" podStartSLOduration=66.228267216 podStartE2EDuration="1m11.078131628s" totalImagesPullingTime="4.849864412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:47.07773367 +0000 UTC m=+71.718719245" watchObservedRunningTime="2026-06-11 22:53:47.078131628 +0000 UTC m=+71.719117203" Jun 11 22:54:14.140847 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:54:14.140817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:54:14.141285 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:54:14.140955 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:54:14.141285 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:54:14.141042 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:18.141008881 +0000 UTC m=+162.781994448 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:54:18.052072 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:54:18.052039 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ln7b9" Jun 11 22:54:45.648480 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:54:45.648447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:54:45.648924 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:54:45.648566 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 22:54:45.648924 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:54:45.648618 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs podName:eb1e4f12-f689-4b12-8e6a-2128b82645b8 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:47.64860329 +0000 UTC m=+252.289588844 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs") pod "network-metrics-daemon-t5tdb" (UID: "eb1e4f12-f689-4b12-8e6a-2128b82645b8") : secret "metrics-daemon-secret" not found Jun 11 22:55:13.257827 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:13.257782 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r8k6t" podUID="ae410fb1-2876-44ab-8d38-c921292c6084" Jun 11 22:55:14.253225 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:14.253193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:55:14.822863 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:14.822825 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t5tdb" podUID="eb1e4f12-f689-4b12-8e6a-2128b82645b8" Jun 11 22:55:18.169278 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:18.169235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:55:18.169644 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:18.169326 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:55:18.169644 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:18.169383 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls podName:ae410fb1-2876-44ab-8d38-c921292c6084 nodeName:}" failed. No retries permitted until 2026-06-11 22:57:20.169369462 +0000 UTC m=+284.810355015 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls") pod "dns-default-r8k6t" (UID: "ae410fb1-2876-44ab-8d38-c921292c6084") : secret "dns-default-metrics-tls" not found Jun 11 22:55:26.796759 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:26.796680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:55:31.293147 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:31.293064 2574 generic.go:356] "Generic (PLEG): container finished" podID="cc9e5861-8597-4c74-a671-5c045b497d8a" containerID="c633e6954eb2bfb10921a0b1dd362e39c72a83af799350b3041948b353bee1d4" exitCode=255 Jun 11 22:55:31.293147 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:31.293118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" event={"ID":"cc9e5861-8597-4c74-a671-5c045b497d8a","Type":"ContainerDied","Data":"c633e6954eb2bfb10921a0b1dd362e39c72a83af799350b3041948b353bee1d4"} Jun 11 22:55:31.298638 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:31.298614 2574 scope.go:117] "RemoveContainer" containerID="c633e6954eb2bfb10921a0b1dd362e39c72a83af799350b3041948b353bee1d4" Jun 11 22:55:32.297182 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:32.297144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc6699fd4-pprb6" event={"ID":"cc9e5861-8597-4c74-a671-5c045b497d8a","Type":"ContainerStarted","Data":"ec100cd1f52e9178ff07070baa39276d1b0bbc3e1aa39ea2e33b75358a975c08"} Jun 11 22:55:42.549103 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.549068 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z"] Jun 11 22:55:42.551103 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.551086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.552102 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.552072 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:55:42.553824 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.553802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.554061 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.554042 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79648d7988-jxshk"] Jun 11 22:55:42.555776 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.555759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.555867 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.555799 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fzpfc\"" Jun 11 22:55:42.556556 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.556538 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 22:55:42.557977 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.557682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.558393 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.558379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rjskh\"" Jun 11 22:55:42.558708 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.558693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 22:55:42.559416 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.559388 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 22:55:42.559548 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.559536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 22:55:42.559606 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.559587 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 22:55:42.559648 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.559632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.559692 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.559679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 22:55:42.563111 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.563092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 22:55:42.563355 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.563333 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.563463 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.563391 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 22:55:42.565404 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.565382 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.565688 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.565671 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ct5jp\"" Jun 11 22:55:42.566406 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.566364 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 22:55:42.572762 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.572743 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:55:42.575976 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.575957 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79648d7988-jxshk"] Jun 11 22:55:42.580390 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.580369 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z"] Jun 11 22:55:42.634032 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634139 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xdqm\" (UniqueName: \"kubernetes.io/projected/82c08e33-96ff-4c7e-9128-b568a297ad06-kube-api-access-6xdqm\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.634139 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634139 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-default-certificate\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.634300 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634300 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634300 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgtwz\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634300 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.634300 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx78g\" (UniqueName: \"kubernetes.io/projected/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-kube-api-access-wx78g\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-stats-auth\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.634599 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.634468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.645315 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.645296 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mkt9h"] Jun 11 22:55:42.647110 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.647097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.650251 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.650233 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-27hx7"] Jun 11 22:55:42.650822 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.650808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-llfxd\"" Jun 11 22:55:42.650929 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.650912 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 22:55:42.651190 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.651172 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 22:55:42.651890 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.651866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.654845 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.654826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 22:55:42.655001 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.654986 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.655109 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.655092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4vt5s\"" Jun 11 22:55:42.655268 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.655252 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.655328 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.655272 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 22:55:42.661102 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.661083 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 22:55:42.661720 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.661701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mkt9h"] Jun 11 22:55:42.665485 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.665464 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-27hx7"] Jun 11 22:55:42.735250 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.735366 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.735366 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.735366 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-tmp\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.735524 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54669224-0235-452b-a132-b56cb7551c7a-serving-cert\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.735524 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.735524 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.735420 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 22:55:42.735524 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xdqm\" (UniqueName: \"kubernetes.io/projected/82c08e33-96ff-4c7e-9128-b568a297ad06-kube-api-access-6xdqm\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.735524 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.735462 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.235442817 +0000 UTC m=+187.876428395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : configmap references non-existent config key: service-ca.crt Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.735559 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls podName:82c08e33-96ff-4c7e-9128-b568a297ad06 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.235544488 +0000 UTC m=+187.876530052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kd85z" (UID: "82c08e33-96ff-4c7e-9128-b568a297ad06") : secret "samples-operator-tls" not found Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnk6w\" (UniqueName: \"kubernetes.io/projected/54669224-0235-452b-a132-b56cb7551c7a-kube-api-access-rnk6w\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx78g\" (UniqueName: \"kubernetes.io/projected/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-kube-api-access-wx78g\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.735795 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-stats-auth\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9162cf6b-632a-481a-918b-6f42ecc96ef1-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.735967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-snapshots\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.736062 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-default-certificate\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.736107 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.236090858 +0000 UTC m=+187.877076413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : secret "router-metrics-certs-default" not found Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736174 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtwz\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736352 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.736439 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.736459 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-765d7cd7c5-cw85g: secret "image-registry-tls" not found Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.736551 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls podName:e7c008f4-a4a7-4b9e-9524-15f5c3689c12 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.236536017 +0000 UTC m=+187.877521585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls") pod "image-registry-765d7cd7c5-cw85g" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12") : secret "image-registry-tls" not found Jun 11 22:55:42.736717 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.736949 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.736927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.738147 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.738128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.738256 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.738153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.738322 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.738273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-stats-auth\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.738472 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.738453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-default-certificate\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.744477 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.744433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xdqm\" (UniqueName: \"kubernetes.io/projected/82c08e33-96ff-4c7e-9128-b568a297ad06-kube-api-access-6xdqm\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:42.744974 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.744949 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx78g\" (UniqueName: \"kubernetes.io/projected/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-kube-api-access-wx78g\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:42.745299 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.745280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.745916 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.745895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtwz\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:42.836891 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.836869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.836981 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.836894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-snapshots\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-tmp\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837131 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54669224-0235-452b-a132-b56cb7551c7a-serving-cert\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837179 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837220 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnk6w\" (UniqueName: \"kubernetes.io/projected/54669224-0235-452b-a132-b56cb7551c7a-kube-api-access-rnk6w\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837334 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.837418 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9162cf6b-632a-481a-918b-6f42ecc96ef1-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.837418 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-tmp\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/54669224-0235-452b-a132-b56cb7551c7a-snapshots\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837523 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.837479 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 22:55:42.837628 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:42.837533 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert podName:9162cf6b-632a-481a-918b-6f42ecc96ef1 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.337516992 +0000 UTC m=+187.978502547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mkt9h" (UID: "9162cf6b-632a-481a-918b-6f42ecc96ef1") : secret "networking-console-plugin-cert" not found Jun 11 22:55:42.837733 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837850 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54669224-0235-452b-a132-b56cb7551c7a-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.837888 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.837876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9162cf6b-632a-481a-918b-6f42ecc96ef1-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:42.839314 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.839299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54669224-0235-452b-a132-b56cb7551c7a-serving-cert\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.847629 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.847610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnk6w\" (UniqueName: \"kubernetes.io/projected/54669224-0235-452b-a132-b56cb7551c7a-kube-api-access-rnk6w\") pod \"insights-operator-5bbd86d6bd-27hx7\" (UID: \"54669224-0235-452b-a132-b56cb7551c7a\") " pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:42.962452 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:42.962419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" Jun 11 22:55:43.079095 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.079064 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-27hx7"] Jun 11 22:55:43.082212 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:55:43.082180 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54669224_0235_452b_a132_b56cb7551c7a.slice/crio-e8da51f9d007cb6d4f428efd102519c6c1381eec36a524763010e51c1e00c633 WatchSource:0}: Error finding container e8da51f9d007cb6d4f428efd102519c6c1381eec36a524763010e51c1e00c633: Status 404 returned error can't find the container with id e8da51f9d007cb6d4f428efd102519c6c1381eec36a524763010e51c1e00c633 Jun 11 22:55:43.240996 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.240926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:43.240996 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.240967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:43.240996 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.240989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:43.241180 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.241095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:43.241180 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241115 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 22:55:43.241180 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241165 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 22:55:43.241180 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241118 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:55:43.241303 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241183 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.241163283 +0000 UTC m=+188.882148852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : configmap references non-existent config key: service-ca.crt Jun 11 22:55:43.241303 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241192 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-765d7cd7c5-cw85g: secret "image-registry-tls" not found Jun 11 22:55:43.241303 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241206 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.24119355 +0000 UTC m=+188.882179123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : secret "router-metrics-certs-default" not found Jun 11 22:55:43.241303 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241219 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls podName:82c08e33-96ff-4c7e-9128-b568a297ad06 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.241213141 +0000 UTC m=+188.882198695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kd85z" (UID: "82c08e33-96ff-4c7e-9128-b568a297ad06") : secret "samples-operator-tls" not found Jun 11 22:55:43.241303 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.241236 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls podName:e7c008f4-a4a7-4b9e-9524-15f5c3689c12 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.241222777 +0000 UTC m=+188.882208332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls") pod "image-registry-765d7cd7c5-cw85g" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12") : secret "image-registry-tls" not found Jun 11 22:55:43.329501 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.329478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" event={"ID":"54669224-0235-452b-a132-b56cb7551c7a","Type":"ContainerStarted","Data":"e8da51f9d007cb6d4f428efd102519c6c1381eec36a524763010e51c1e00c633"} Jun 11 22:55:43.341851 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:43.341834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:43.341978 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.341963 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 22:55:43.342017 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:43.342010 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert podName:9162cf6b-632a-481a-918b-6f42ecc96ef1 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.341999076 +0000 UTC m=+188.982984630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mkt9h" (UID: "9162cf6b-632a-481a-918b-6f42ecc96ef1") : secret "networking-console-plugin-cert" not found Jun 11 22:55:44.249458 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:44.249427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:44.249458 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:44.249463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:44.249486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:44.249507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249573 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249593 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249578 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249627 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-765d7cd7c5-cw85g: secret "image-registry-tls" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249633 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.249616343 +0000 UTC m=+190.890601916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : configmap references non-existent config key: service-ca.crt Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249656 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls podName:e7c008f4-a4a7-4b9e-9524-15f5c3689c12 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.249642363 +0000 UTC m=+190.890627917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls") pod "image-registry-765d7cd7c5-cw85g" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12") : secret "image-registry-tls" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249673 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.249665027 +0000 UTC m=+190.890650581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : secret "router-metrics-certs-default" not found Jun 11 22:55:44.249850 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.249683 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls podName:82c08e33-96ff-4c7e-9128-b568a297ad06 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.249677902 +0000 UTC m=+190.890663456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kd85z" (UID: "82c08e33-96ff-4c7e-9128-b568a297ad06") : secret "samples-operator-tls" not found Jun 11 22:55:44.350813 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:44.350782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:44.350979 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.350880 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 22:55:44.350979 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:44.350928 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert podName:9162cf6b-632a-481a-918b-6f42ecc96ef1 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.350915472 +0000 UTC m=+190.991901026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mkt9h" (UID: "9162cf6b-632a-481a-918b-6f42ecc96ef1") : secret "networking-console-plugin-cert" not found Jun 11 22:55:45.337387 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:45.337355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" event={"ID":"54669224-0235-452b-a132-b56cb7551c7a","Type":"ContainerStarted","Data":"2251327168a16f0c949f14a6f680fd29e4f21e9fdc1ada85d0cbd80470efd3b1"} Jun 11 22:55:45.356766 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:45.356718 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" podStartSLOduration=1.417601629 podStartE2EDuration="3.356705008s" totalImagesPullingTime="1.939103379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:45.35644886 +0000 UTC m=+189.997434448" watchObservedRunningTime="2026-06-11 22:55:45.356705008 +0000 UTC m=+189.997690584" Jun 11 22:55:46.128304 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.128273 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nqn"] Jun 11 22:55:46.130542 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.130517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.133436 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.133400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 22:55:46.133436 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.133415 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 22:55:46.133728 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.133711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kfbj2\"" Jun 11 22:55:46.141666 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.141646 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nqn"] Jun 11 22:55:46.165270 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.165248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/815143d8-11e7-44c2-80a6-878ff15ea41e-data-volume\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.165392 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.165303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.165449 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.165435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qcs8\" (UniqueName: \"kubernetes.io/projected/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-api-access-9qcs8\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.165503 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.165487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/815143d8-11e7-44c2-80a6-878ff15ea41e-crio-socket\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.165540 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.165516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.265885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.265857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qcs8\" (UniqueName: \"kubernetes.io/projected/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-api-access-9qcs8\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266047 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.265907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/815143d8-11e7-44c2-80a6-878ff15ea41e-crio-socket\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266047 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.265926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266047 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.265984 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:46.266047 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.265999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/815143d8-11e7-44c2-80a6-878ff15ea41e-crio-socket\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:46.266183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/815143d8-11e7-44c2-80a6-878ff15ea41e-data-volume\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266124 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 22:55:46.266183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266146 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.76611693 +0000 UTC m=+191.407102498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : configmap "kube-rbac-proxy" not found Jun 11 22:55:46.266183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.26616848 +0000 UTC m=+194.907154041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : secret "router-metrics-certs-default" not found Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266315 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.266370 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.766345506 +0000 UTC m=+191.407331062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266384 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266395 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266405 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-765d7cd7c5-cw85g: secret "image-registry-tls" not found Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.266411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/815143d8-11e7-44c2-80a6-878ff15ea41e-data-volume\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266427 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls podName:82c08e33-96ff-4c7e-9128-b568a297ad06 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.266409381 +0000 UTC m=+194.907394936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kd85z" (UID: "82c08e33-96ff-4c7e-9128-b568a297ad06") : secret "samples-operator-tls" not found Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.266436273 +0000 UTC m=+194.907421826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : configmap references non-existent config key: service-ca.crt Jun 11 22:55:46.266567 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.266452 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls podName:e7c008f4-a4a7-4b9e-9524-15f5c3689c12 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.266447465 +0000 UTC m=+194.907433019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls") pod "image-registry-765d7cd7c5-cw85g" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12") : secret "image-registry-tls" not found Jun 11 22:55:46.277706 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.277685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qcs8\" (UniqueName: \"kubernetes.io/projected/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-api-access-9qcs8\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.367603 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.367577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:46.368046 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.367730 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 22:55:46.368046 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.367800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert podName:9162cf6b-632a-481a-918b-6f42ecc96ef1 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.367781653 +0000 UTC m=+195.008767206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mkt9h" (UID: "9162cf6b-632a-481a-918b-6f42ecc96ef1") : secret "networking-console-plugin-cert" not found Jun 11 22:55:46.770571 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.770534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.770751 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.770653 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:46.770751 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:46.770695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:46.770751 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.770725 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:47.770711314 +0000 UTC m=+192.411696871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : configmap "kube-rbac-proxy" not found Jun 11 22:55:46.770915 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.770780 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.770915 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:46.770826 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:47.770814124 +0000 UTC m=+192.411799678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:47.780733 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:47.780691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:47.781183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:47.780759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:47.781183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:47.780819 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:47.781183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:47.780902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:49.780882404 +0000 UTC m=+194.421867977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : configmap "kube-rbac-proxy" not found Jun 11 22:55:47.781183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:47.780909 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:47.781183 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:47.780948 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:49.780937494 +0000 UTC m=+194.421923055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:48.096338 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:48.096311 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hl8kw_d17bb9ff-7f34-4864-ad31-49a434929a5c/dns-node-resolver/0.log" Jun 11 22:55:49.099788 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:49.099760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jt8sv_9c00acbb-c757-4694-afca-3489ab3075ce/node-ca/0.log" Jun 11 22:55:49.797273 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:49.797235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:49.797443 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:49.797364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:49.797443 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:49.797397 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:49.797519 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:49.797454 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:53.797440749 +0000 UTC m=+198.438426307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:49.797519 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:49.797475 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:49.797587 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:49.797535 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:55:53.797523415 +0000 UTC m=+198.438508970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : configmap "kube-rbac-proxy" not found Jun 11 22:55:49.895015 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:49.894988 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9cvs_e3dd3ec7-a97d-4605-beea-94558f91aacc/serve-healthcheck-canary/0.log" Jun 11 22:55:50.302620 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:50.302587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:50.302620 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:50.302629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:50.302661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:50.302680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302759 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302776 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.302759072 +0000 UTC m=+202.943744627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : configmap references non-existent config key: service-ca.crt Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302808 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls podName:82c08e33-96ff-4c7e-9128-b568a297ad06 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.302796103 +0000 UTC m=+202.943781658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kd85z" (UID: "82c08e33-96ff-4c7e-9128-b568a297ad06") : secret "samples-operator-tls" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302828 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302847 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-765d7cd7c5-cw85g: secret "image-registry-tls" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302880 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls podName:e7c008f4-a4a7-4b9e-9524-15f5c3689c12 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.302871009 +0000 UTC m=+202.943856568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls") pod "image-registry-765d7cd7c5-cw85g" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12") : secret "image-registry-tls" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302825 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 22:55:50.303074 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.302907 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs podName:9c82f1f3-56a3-4bee-8b0b-5a11f974ab41 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.302901403 +0000 UTC m=+202.943886957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs") pod "router-default-79648d7988-jxshk" (UID: "9c82f1f3-56a3-4bee-8b0b-5a11f974ab41") : secret "router-metrics-certs-default" not found Jun 11 22:55:50.403928 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:50.403893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:50.404088 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.404051 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 22:55:50.404147 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:50.404107 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert podName:9162cf6b-632a-481a-918b-6f42ecc96ef1 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.40409195 +0000 UTC m=+203.045077507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mkt9h" (UID: "9162cf6b-632a-481a-918b-6f42ecc96ef1") : secret "networking-console-plugin-cert" not found Jun 11 22:55:53.830610 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:53.830575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:53.831015 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:53.830635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:55:53.831015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:53.830700 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:53.831015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:53.830758 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:53.831015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:53.830761 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:56:01.830745649 +0000 UTC m=+206.471731203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : configmap "kube-rbac-proxy" not found Jun 11 22:55:53.831015 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:55:53.830804 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls podName:815143d8-11e7-44c2-80a6-878ff15ea41e nodeName:}" failed. No retries permitted until 2026-06-11 22:56:01.830793218 +0000 UTC m=+206.471778773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6nqn" (UID: "815143d8-11e7-44c2-80a6-878ff15ea41e") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:58.363914 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.363878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:58.363914 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.363922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:58.364425 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.363955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:58.364425 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.363976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:58.364680 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.364647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-service-ca-bundle\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:58.366356 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.366335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"image-registry-765d7cd7c5-cw85g\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:58.366442 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.366404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c82f1f3-56a3-4bee-8b0b-5a11f974ab41-metrics-certs\") pod \"router-default-79648d7988-jxshk\" (UID: \"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41\") " pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:58.366498 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.366483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c08e33-96ff-4c7e-9128-b568a297ad06-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kd85z\" (UID: \"82c08e33-96ff-4c7e-9128-b568a297ad06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:58.461283 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.461244 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" Jun 11 22:55:58.464484 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.464332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:58.466643 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.466624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9162cf6b-632a-481a-918b-6f42ecc96ef1-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mkt9h\" (UID: \"9162cf6b-632a-481a-918b-6f42ecc96ef1\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:58.468242 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.468221 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:58.472334 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.472301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:58.555431 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.555362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" Jun 11 22:55:58.614392 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.614233 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z"] Jun 11 22:55:58.623183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.623156 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:55:58.630118 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:55:58.630095 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c008f4_a4a7_4b9e_9524_15f5c3689c12.slice/crio-0b610b1710eeda21da0fb4411c7f4c7c88e730e0ff12620f0fe4d501ad0cd9ac WatchSource:0}: Error finding container 0b610b1710eeda21da0fb4411c7f4c7c88e730e0ff12620f0fe4d501ad0cd9ac: Status 404 returned error can't find the container with id 0b610b1710eeda21da0fb4411c7f4c7c88e730e0ff12620f0fe4d501ad0cd9ac Jun 11 22:55:58.637405 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.637330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79648d7988-jxshk"] Jun 11 22:55:58.645074 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:55:58.645046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c82f1f3_56a3_4bee_8b0b_5a11f974ab41.slice/crio-aa59fb8db3f6ca10ae6dfff59b884d677d51080b073e2c28b39fc7a7e6cfb8f6 WatchSource:0}: Error finding container aa59fb8db3f6ca10ae6dfff59b884d677d51080b073e2c28b39fc7a7e6cfb8f6: Status 404 returned error can't find the container with id aa59fb8db3f6ca10ae6dfff59b884d677d51080b073e2c28b39fc7a7e6cfb8f6 Jun 11 22:55:58.692523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:58.692498 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mkt9h"] Jun 11 22:55:58.695821 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:55:58.695793 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9162cf6b_632a_481a_918b_6f42ecc96ef1.slice/crio-90f26cfa66433812d4f31d7c9fc4278edb2fb20315a1ea9681b4e058186fe9db WatchSource:0}: Error finding container 90f26cfa66433812d4f31d7c9fc4278edb2fb20315a1ea9681b4e058186fe9db: Status 404 returned error can't find the container with id 90f26cfa66433812d4f31d7c9fc4278edb2fb20315a1ea9681b4e058186fe9db Jun 11 22:55:59.387669 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.387629 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" event={"ID":"9162cf6b-632a-481a-918b-6f42ecc96ef1","Type":"ContainerStarted","Data":"90f26cfa66433812d4f31d7c9fc4278edb2fb20315a1ea9681b4e058186fe9db"} Jun 11 22:55:59.389478 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.389439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79648d7988-jxshk" event={"ID":"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41","Type":"ContainerStarted","Data":"466a43be0bc4d4cd7360ad82ff265129cb2b475c5cecba9c64a0b6b0c31d1d6f"} Jun 11 22:55:59.389619 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.389487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79648d7988-jxshk" event={"ID":"9c82f1f3-56a3-4bee-8b0b-5a11f974ab41","Type":"ContainerStarted","Data":"aa59fb8db3f6ca10ae6dfff59b884d677d51080b073e2c28b39fc7a7e6cfb8f6"} Jun 11 22:55:59.391271 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.391234 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" event={"ID":"e7c008f4-a4a7-4b9e-9524-15f5c3689c12","Type":"ContainerStarted","Data":"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643"} Jun 11 22:55:59.391412 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.391277 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" event={"ID":"e7c008f4-a4a7-4b9e-9524-15f5c3689c12","Type":"ContainerStarted","Data":"0b610b1710eeda21da0fb4411c7f4c7c88e730e0ff12620f0fe4d501ad0cd9ac"} Jun 11 22:55:59.391412 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.391338 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:55:59.392399 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.392368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" event={"ID":"82c08e33-96ff-4c7e-9128-b568a297ad06","Type":"ContainerStarted","Data":"082834dfb5e32ad880abbe10b85122cf813457e5462ac40dde9f83fa81339377"} Jun 11 22:55:59.410056 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.409999 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79648d7988-jxshk" podStartSLOduration=17.409986283 podStartE2EDuration="17.409986283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:59.409100187 +0000 UTC m=+204.050085766" watchObservedRunningTime="2026-06-11 22:55:59.409986283 +0000 UTC m=+204.050971852" Jun 11 22:55:59.428224 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.428171 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" podStartSLOduration=17.428155524 podStartE2EDuration="17.428155524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:59.427348025 +0000 UTC m=+204.068333632" watchObservedRunningTime="2026-06-11 22:55:59.428155524 +0000 UTC m=+204.069141100" Jun 11 22:55:59.472740 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.472659 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:55:59.475801 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:55:59.475775 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:56:00.395747 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:00.395723 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:56:00.396999 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:00.396977 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79648d7988-jxshk" Jun 11 22:56:01.399873 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.399830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" event={"ID":"82c08e33-96ff-4c7e-9128-b568a297ad06","Type":"ContainerStarted","Data":"1d9f485c608c583b6d413b44dccc2b3a3e96f6e7a4bb00a0856bbd94b67345df"} Jun 11 22:56:01.400358 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.399889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" event={"ID":"82c08e33-96ff-4c7e-9128-b568a297ad06","Type":"ContainerStarted","Data":"65ed1e4d9a1b508170ac7ddc9c6d87c9c6e971ff252d0321c01756a2aeedfc23"} Jun 11 22:56:01.401490 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.401467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" event={"ID":"9162cf6b-632a-481a-918b-6f42ecc96ef1","Type":"ContainerStarted","Data":"620bf25a13a0b7876cd0dbe09d34bc49eeff3e394ca290cf9e6e81388c32d730"} Jun 11 22:56:01.416755 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.416708 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kd85z" podStartSLOduration=17.717436451 podStartE2EDuration="19.416691563s" totalImagesPullingTime="1.699255112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:01.416391411 +0000 UTC m=+206.057377000" watchObservedRunningTime="2026-06-11 22:56:01.416691563 +0000 UTC m=+206.057677139" Jun 11 22:56:01.432960 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.432905 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-mkt9h" podStartSLOduration=17.765261806 podStartE2EDuration="19.432886648s" totalImagesPullingTime="1.667624842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:01.432164969 +0000 UTC m=+206.073150547" watchObservedRunningTime="2026-06-11 22:56:01.432886648 +0000 UTC m=+206.073872225" Jun 11 22:56:01.895979 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.895935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:56:01.896202 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.896054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:56:01.896597 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.896567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/815143d8-11e7-44c2-80a6-878ff15ea41e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:56:01.898471 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:01.898450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/815143d8-11e7-44c2-80a6-878ff15ea41e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nqn\" (UID: \"815143d8-11e7-44c2-80a6-878ff15ea41e\") " pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:56:02.040238 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:02.040188 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6nqn" Jun 11 22:56:02.165565 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:02.165365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nqn"] Jun 11 22:56:02.167991 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:56:02.167961 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815143d8_11e7_44c2_80a6_878ff15ea41e.slice/crio-3cd52d982374444be85f627a9cbcd85f7f0f1f779acf5fc3a552cec80ab47c73 WatchSource:0}: Error finding container 3cd52d982374444be85f627a9cbcd85f7f0f1f779acf5fc3a552cec80ab47c73: Status 404 returned error can't find the container with id 3cd52d982374444be85f627a9cbcd85f7f0f1f779acf5fc3a552cec80ab47c73 Jun 11 22:56:02.406113 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:02.406068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nqn" event={"ID":"815143d8-11e7-44c2-80a6-878ff15ea41e","Type":"ContainerStarted","Data":"3cd52d982374444be85f627a9cbcd85f7f0f1f779acf5fc3a552cec80ab47c73"} Jun 11 22:56:06.421879 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:06.421845 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nqn" event={"ID":"815143d8-11e7-44c2-80a6-878ff15ea41e","Type":"ContainerStarted","Data":"8ff941763639962e48ad7f389645e35832627e93aa2b9908405ca8ce2791165f"} Jun 11 22:56:06.422270 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:06.421903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nqn" event={"ID":"815143d8-11e7-44c2-80a6-878ff15ea41e","Type":"ContainerStarted","Data":"d67884ca344544d427e82b990ce7f3f5cd783713fbfbc97ab1e5ea2a7ae274d3"} Jun 11 22:56:08.431260 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:08.431227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nqn" event={"ID":"815143d8-11e7-44c2-80a6-878ff15ea41e","Type":"ContainerStarted","Data":"39a596e39de7322caf95364ccdc9336aa4bc2a2baad30ddbbe9b5a9a80e3765a"} Jun 11 22:56:08.452980 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:08.452932 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6nqn" podStartSLOduration=16.708110519 podStartE2EDuration="22.452918s" totalImagesPullingTime="5.744807481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:55:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:08.45110619 +0000 UTC m=+213.092091765" watchObservedRunningTime="2026-06-11 22:56:08.452918 +0000 UTC m=+213.093903566" Jun 11 22:56:09.006438 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.006409 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:56:09.036943 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.036900 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-867c974c55-58nrt"] Jun 11 22:56:09.040292 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.040275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.054738 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.054693 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867c974c55-58nrt"] Jun 11 22:56:09.155861 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.155829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-image-registry-private-configuration\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.155874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-installation-pull-secrets\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.155896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-registry-certificates\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.155997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-trusted-ca\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156074 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.156064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-bound-sa-token\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156264 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.156099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgnpd\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-kube-api-access-fgnpd\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156264 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.156127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-registry-tls\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.156264 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.156164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b953fe2-f885-491a-97d1-9717822cf456-ca-trust-extracted\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257468 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-registry-certificates\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257615 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-trusted-ca\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257615 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-bound-sa-token\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257615 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgnpd\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-kube-api-access-fgnpd\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257615 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-registry-tls\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257789 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b953fe2-f885-491a-97d1-9717822cf456-ca-trust-extracted\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257789 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-image-registry-private-configuration\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.257789 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.257695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-installation-pull-secrets\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.258169 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.258142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b953fe2-f885-491a-97d1-9717822cf456-ca-trust-extracted\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.258347 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.258327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-registry-certificates\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.258723 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.258699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b953fe2-f885-491a-97d1-9717822cf456-trusted-ca\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.260200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.260179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-installation-pull-secrets\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.260345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.260319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b953fe2-f885-491a-97d1-9717822cf456-image-registry-private-configuration\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.260437 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.260424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-registry-tls\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.266779 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.266756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgnpd\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-kube-api-access-fgnpd\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.271880 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.271859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b953fe2-f885-491a-97d1-9717822cf456-bound-sa-token\") pod \"image-registry-867c974c55-58nrt\" (UID: \"9b953fe2-f885-491a-97d1-9717822cf456\") " pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.349208 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.349171 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:09.484088 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:09.484064 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867c974c55-58nrt"] Jun 11 22:56:09.486307 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:56:09.486284 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b953fe2_f885_491a_97d1_9717822cf456.slice/crio-ebea28cce0a45e0f7906b53c97aeb25123d83e08a80825bdc29fd12c3ae69f51 WatchSource:0}: Error finding container ebea28cce0a45e0f7906b53c97aeb25123d83e08a80825bdc29fd12c3ae69f51: Status 404 returned error can't find the container with id ebea28cce0a45e0f7906b53c97aeb25123d83e08a80825bdc29fd12c3ae69f51 Jun 11 22:56:10.439348 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:10.439306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867c974c55-58nrt" event={"ID":"9b953fe2-f885-491a-97d1-9717822cf456","Type":"ContainerStarted","Data":"1be76c16efae9dc57a219c70c808ec310f4f1a6b15966774e747b51a6dbf88f2"} Jun 11 22:56:10.439348 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:10.439355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867c974c55-58nrt" event={"ID":"9b953fe2-f885-491a-97d1-9717822cf456","Type":"ContainerStarted","Data":"ebea28cce0a45e0f7906b53c97aeb25123d83e08a80825bdc29fd12c3ae69f51"} Jun 11 22:56:10.439676 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:10.439415 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:10.462122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:10.462076 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podStartSLOduration=1.462059333 podStartE2EDuration="1.462059333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:10.461530376 +0000 UTC m=+215.102515954" watchObservedRunningTime="2026-06-11 22:56:10.462059333 +0000 UTC m=+215.103044909" Jun 11 22:56:16.126186 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.126153 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sls9d"] Jun 11 22:56:16.131307 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.131286 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.134182 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.134160 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 22:56:16.134594 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.134578 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 22:56:16.134729 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.134710 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 22:56:16.134787 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.134712 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 22:56:16.135871 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.135851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 22:56:16.136001 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.135913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 22:56:16.136001 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.135963 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9zjvk\"" Jun 11 22:56:16.208401 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-accelerators-collector-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-wtmp\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-sys\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-root\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208523 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-textfile\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208711 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtr6l\" (UniqueName: \"kubernetes.io/projected/73413fc8-b712-4eb0-8d99-48a45b3a9551-kube-api-access-gtr6l\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208711 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208711 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-metrics-client-ca\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.208711 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.208659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309217 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-wtmp\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309335 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-sys\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309335 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-root\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309335 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-textfile\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309335 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-sys\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309335 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtr6l\" (UniqueName: \"kubernetes.io/projected/73413fc8-b712-4eb0-8d99-48a45b3a9551-kube-api-access-gtr6l\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-root\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-wtmp\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-metrics-client-ca\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:56:16.309418 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:56:16.309457 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls podName:73413fc8-b712-4eb0-8d99-48a45b3a9551 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:16.809442952 +0000 UTC m=+221.450428509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls") pod "node-exporter-sls9d" (UID: "73413fc8-b712-4eb0-8d99-48a45b3a9551") : secret "node-exporter-tls" not found Jun 11 22:56:16.309590 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-accelerators-collector-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-textfile\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309910 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-metrics-client-ca\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.309942 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.309905 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-accelerators-collector-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.311607 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.311590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.324809 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.324790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtr6l\" (UniqueName: \"kubernetes.io/projected/73413fc8-b712-4eb0-8d99-48a45b3a9551-kube-api-access-gtr6l\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.813431 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.813409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:16.815542 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:16.815526 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73413fc8-b712-4eb0-8d99-48a45b3a9551-node-exporter-tls\") pod \"node-exporter-sls9d\" (UID: \"73413fc8-b712-4eb0-8d99-48a45b3a9551\") " pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:17.041663 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:17.041642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sls9d" Jun 11 22:56:17.052543 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:56:17.052522 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73413fc8_b712_4eb0_8d99_48a45b3a9551.slice/crio-c5195d1583220831db3f4ce96bbdce75d907d2af25f527e6782b8b038526e4b6 WatchSource:0}: Error finding container c5195d1583220831db3f4ce96bbdce75d907d2af25f527e6782b8b038526e4b6: Status 404 returned error can't find the container with id c5195d1583220831db3f4ce96bbdce75d907d2af25f527e6782b8b038526e4b6 Jun 11 22:56:17.462952 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:17.462913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sls9d" event={"ID":"73413fc8-b712-4eb0-8d99-48a45b3a9551","Type":"ContainerStarted","Data":"c5195d1583220831db3f4ce96bbdce75d907d2af25f527e6782b8b038526e4b6"} Jun 11 22:56:18.467653 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:18.467620 2574 generic.go:356] "Generic (PLEG): container finished" podID="73413fc8-b712-4eb0-8d99-48a45b3a9551" containerID="b8be1b6aa84f7a387b53982ea6edfc7eea76b6d18d699d33e5e44e39f099026d" exitCode=0 Jun 11 22:56:18.468064 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:18.467706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sls9d" event={"ID":"73413fc8-b712-4eb0-8d99-48a45b3a9551","Type":"ContainerDied","Data":"b8be1b6aa84f7a387b53982ea6edfc7eea76b6d18d699d33e5e44e39f099026d"} Jun 11 22:56:19.011419 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:19.011382 2574 patch_prober.go:28] interesting pod/image-registry-765d7cd7c5-cw85g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:19.011585 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:19.011438 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:19.473149 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:19.473110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sls9d" event={"ID":"73413fc8-b712-4eb0-8d99-48a45b3a9551","Type":"ContainerStarted","Data":"073e98fb938f3e6b10cd1e361862db6799aa941ff974894177cb7a69efbf30d0"} Jun 11 22:56:19.473650 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:19.473170 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sls9d" event={"ID":"73413fc8-b712-4eb0-8d99-48a45b3a9551","Type":"ContainerStarted","Data":"9721caf175aa0230c4e67c85bf4a20289e68553a7a91ba865db411dd2a8268a7"} Jun 11 22:56:19.498214 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:19.498165 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sls9d" podStartSLOduration=2.528883065 podStartE2EDuration="3.498150047s" totalImagesPullingTime="906.77233ms" totalInitContainerRuntime="62.494652ms" isStatefulPod=true podCreationTimestamp="2026-06-11 22:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:19.495968209 +0000 UTC m=+224.136953798" watchObservedRunningTime="2026-06-11 22:56:19.498150047 +0000 UTC m=+224.139135622" Jun 11 22:56:22.298756 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.298720 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:56:22.301938 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.301922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.304920 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.304867 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 22:56:22.305079 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305063 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 22:56:22.305150 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305080 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 22:56:22.305150 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305140 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 22:56:22.305262 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305176 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 22:56:22.305315 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 22:56:22.305367 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305333 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 22:56:22.305454 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305381 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 22:56:22.305502 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 22:56:22.305544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 22:56:22.305591 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305551 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 22:56:22.305591 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.305568 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 22:56:22.306944 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.306927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 22:56:22.307094 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.306927 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 22:56:22.307094 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.306979 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wrx7h\"" Jun 11 22:56:22.307094 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.306927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9120p4mgfoteb\"" Jun 11 22:56:22.308702 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.308680 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 22:56:22.321442 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.321418 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:56:22.460212 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460381 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460381 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460381 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460381 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460381 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460544 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460521 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460699 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460872 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460872 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.460872 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.460783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msv4f\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561629 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561745 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561745 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msv4f\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561810 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561810 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.561885 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.561972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562409 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562696 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562696 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.562846 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.562821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.563898 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.563836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.565035 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.564783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.565035 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.564834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.565609 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.565585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566536 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.565725 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566536 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566536 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566536 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566536 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566869 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.566869 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.566801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.567351 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.567325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.567969 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.567945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.568075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.568013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.568075 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.568050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.568308 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.568285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.572143 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.572125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msv4f\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f\") pod \"prometheus-k8s-0\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.611675 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.611646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:22.765533 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:22.765461 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:56:22.767764 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:56:22.767740 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3539e0_84ce_435d_be94_c52767f39266.slice/crio-0cda2bdd5a2db3e180cd7e0c90df808ae9442d15d13d22474fca56a5498dccef WatchSource:0}: Error finding container 0cda2bdd5a2db3e180cd7e0c90df808ae9442d15d13d22474fca56a5498dccef: Status 404 returned error can't find the container with id 0cda2bdd5a2db3e180cd7e0c90df808ae9442d15d13d22474fca56a5498dccef Jun 11 22:56:23.486486 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:23.486449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"0cda2bdd5a2db3e180cd7e0c90df808ae9442d15d13d22474fca56a5498dccef"} Jun 11 22:56:24.494554 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:24.494520 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="3447558774a40d1f2744ff5b5173385ad02255169ef94b3e8420586604eb374d" exitCode=0 Jun 11 22:56:24.495006 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:24.494607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"3447558774a40d1f2744ff5b5173385ad02255169ef94b3e8420586604eb374d"} Jun 11 22:56:28.513006 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:28.512964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"d4f2b1f43788b9d08693fdaf1e4fad22c5852c7bee7f1cd4916ef5102b93b96e"} Jun 11 22:56:28.513527 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:28.513068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"973cbc346e41dea0adb4ace8f31dcca776659b835dc13643c8090c28f0928e75"} Jun 11 22:56:29.012353 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:29.012319 2574 patch_prober.go:28] interesting pod/image-registry-765d7cd7c5-cw85g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:29.012521 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:29.012385 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:29.355622 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:29.355582 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:29.355797 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:29.355645 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:30.523018 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:30.522982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"2acdacbc6fdddc3880376b3681e93cf2fa607a20d17d6ff1dfac1ffa5adfa0c0"} Jun 11 22:56:30.523400 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:30.523081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"2f0ceb9f24601fc32885135855037da6e05bb60850d55327ffa3e9ad57d62df3"} Jun 11 22:56:30.523400 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:30.523123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"38ba194df83af7c0e00c8dc17203cc314a39da22458fa37cbff134b15a8354e1"} Jun 11 22:56:30.523400 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:30.523163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerStarted","Data":"eff7ca9942f6740e63c2bcb3fcd37c031c18d5712dd6a81ab86cace73ab598ed"} Jun 11 22:56:30.564156 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:30.564103 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.774877646 podStartE2EDuration="8.564085024s" totalImagesPullingTime="5.770593186s" totalInitContainerRuntime="18.614192ms" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:30.5585976 +0000 UTC m=+235.199583177" watchObservedRunningTime="2026-06-11 22:56:30.564085024 +0000 UTC m=+235.205070603" Jun 11 22:56:31.447481 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:31.447448 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:31.447632 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:31.447498 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:32.612677 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:32.612641 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:56:34.027901 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.027831 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" containerID="cri-o://0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643" gracePeriod=30 Jun 11 22:56:34.267162 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.267136 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:56:34.362731 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.362697 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.362900 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.362737 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.362900 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.362771 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.362969 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.362948 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.363018 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363001 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgtwz\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.363093 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363064 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.363144 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363103 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.363197 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363156 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") pod \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\" (UID: \"e7c008f4-a4a7-4b9e-9524-15f5c3689c12\") " Jun 11 22:56:34.363606 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363388 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:56:34.363751 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.363632 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:56:34.365263 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.365237 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:56:34.365422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.365290 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:56:34.365422 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.365389 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:56:34.365675 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.365649 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz" (OuterVolumeSpecName: "kube-api-access-fgtwz") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "kube-api-access-fgtwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:56:34.365771 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.365707 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:56:34.371782 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.371757 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7c008f4-a4a7-4b9e-9524-15f5c3689c12" (UID: "e7c008f4-a4a7-4b9e-9524-15f5c3689c12"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:56:34.464078 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464016 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464078 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464070 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-bound-sa-token\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464078 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464081 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-installation-pull-secrets\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464078 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464090 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-image-registry-private-configuration\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464099 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-registry-certificates\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464108 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgtwz\" (UniqueName: \"kubernetes.io/projected/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-kube-api-access-fgtwz\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464116 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-ca-trust-extracted\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.464345 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.464126 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7c008f4-a4a7-4b9e-9524-15f5c3689c12-trusted-ca\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:56:34.537559 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.537527 2574 generic.go:356] "Generic (PLEG): container finished" podID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerID="0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643" exitCode=0 Jun 11 22:56:34.537718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.537568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" event={"ID":"e7c008f4-a4a7-4b9e-9524-15f5c3689c12","Type":"ContainerDied","Data":"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643"} Jun 11 22:56:34.537718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.537605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" event={"ID":"e7c008f4-a4a7-4b9e-9524-15f5c3689c12","Type":"ContainerDied","Data":"0b610b1710eeda21da0fb4411c7f4c7c88e730e0ff12620f0fe4d501ad0cd9ac"} Jun 11 22:56:34.537718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.537623 2574 scope.go:117] "RemoveContainer" containerID="0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643" Jun 11 22:56:34.537718 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.537571 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765d7cd7c5-cw85g" Jun 11 22:56:34.546140 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.546116 2574 scope.go:117] "RemoveContainer" containerID="0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643" Jun 11 22:56:34.546424 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:56:34.546404 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643\": container with ID starting with 0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643 not found: ID does not exist" containerID="0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643" Jun 11 22:56:34.546498 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.546431 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643"} err="failed to get container status \"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643\": rpc error: code = NotFound desc = could not find container \"0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643\": container with ID starting with 0b11b0a17fdd62520ff040b5f4c9e6d35241b2fed5c8f0d7a5fda0e5631ef643 not found: ID does not exist" Jun 11 22:56:34.561440 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.561402 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:56:34.565553 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:34.565528 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-765d7cd7c5-cw85g"] Jun 11 22:56:35.801598 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:35.801569 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" path="/var/lib/kubelet/pods/e7c008f4-a4a7-4b9e-9524-15f5c3689c12/volumes" Jun 11 22:56:39.354000 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:39.353966 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:39.354482 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:39.354018 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:41.447337 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:41.447305 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:41.447694 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:41.447354 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:47.674339 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:47.674295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:56:47.676577 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:47.676559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1e4f12-f689-4b12-8e6a-2128b82645b8-metrics-certs\") pod \"network-metrics-daemon-t5tdb\" (UID: \"eb1e4f12-f689-4b12-8e6a-2128b82645b8\") " pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:56:47.801046 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:47.800693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s94r6\"" Jun 11 22:56:47.807327 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:47.807302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5tdb" Jun 11 22:56:47.941137 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:47.941115 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5tdb"] Jun 11 22:56:47.943558 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:56:47.943534 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1e4f12_f689_4b12_8e6a_2128b82645b8.slice/crio-8b5f0ce2f8708557550d856149e2b176257df03e651ca6a1d6419db3efa641a3 WatchSource:0}: Error finding container 8b5f0ce2f8708557550d856149e2b176257df03e651ca6a1d6419db3efa641a3: Status 404 returned error can't find the container with id 8b5f0ce2f8708557550d856149e2b176257df03e651ca6a1d6419db3efa641a3 Jun 11 22:56:48.587216 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:48.587182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5tdb" event={"ID":"eb1e4f12-f689-4b12-8e6a-2128b82645b8","Type":"ContainerStarted","Data":"8b5f0ce2f8708557550d856149e2b176257df03e651ca6a1d6419db3efa641a3"} Jun 11 22:56:49.354303 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.354269 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:49.354721 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.354319 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:49.354721 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.354355 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:56:49.354843 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.354770 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"1be76c16efae9dc57a219c70c808ec310f4f1a6b15966774e747b51a6dbf88f2"} pod="openshift-image-registry/image-registry-867c974c55-58nrt" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 22:56:49.358438 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.358415 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:49.358572 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.358451 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:49.592472 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.592434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5tdb" event={"ID":"eb1e4f12-f689-4b12-8e6a-2128b82645b8","Type":"ContainerStarted","Data":"eb29ef320e9614ad98623456deeecd85f4c7047f462442f307e9d03f8da7d4da"} Jun 11 22:56:49.592656 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.592496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5tdb" event={"ID":"eb1e4f12-f689-4b12-8e6a-2128b82645b8","Type":"ContainerStarted","Data":"87280d2f2f0556d2c8278d28c35f08f92c53e5ef651ce0cbedc55ea119022f27"} Jun 11 22:56:49.608716 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:49.608620 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t5tdb" podStartSLOduration=252.763172464 podStartE2EDuration="4m13.608603439s" totalImagesPullingTime="845.430975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:49.608493487 +0000 UTC m=+254.249479065" watchObservedRunningTime="2026-06-11 22:56:49.608603439 +0000 UTC m=+254.249589031" Jun 11 22:56:50.597319 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:50.597285 2574 generic.go:356] "Generic (PLEG): container finished" podID="54669224-0235-452b-a132-b56cb7551c7a" containerID="2251327168a16f0c949f14a6f680fd29e4f21e9fdc1ada85d0cbd80470efd3b1" exitCode=0 Jun 11 22:56:50.597914 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:50.597889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" event={"ID":"54669224-0235-452b-a132-b56cb7551c7a","Type":"ContainerDied","Data":"2251327168a16f0c949f14a6f680fd29e4f21e9fdc1ada85d0cbd80470efd3b1"} Jun 11 22:56:50.598237 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:50.598218 2574 scope.go:117] "RemoveContainer" containerID="2251327168a16f0c949f14a6f680fd29e4f21e9fdc1ada85d0cbd80470efd3b1" Jun 11 22:56:51.602830 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:51.602753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-27hx7" event={"ID":"54669224-0235-452b-a132-b56cb7551c7a","Type":"ContainerStarted","Data":"0a55166ce6797a8ff79d883adea09ccfc0f6d0a8fb42c4eb4d79c76fe0390563"} Jun 11 22:56:57.218289 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:57.218259 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/init-textfile/0.log" Jun 11 22:56:57.419183 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:57.419155 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/node-exporter/0.log" Jun 11 22:56:57.619769 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:57.619740 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/kube-rbac-proxy/0.log" Jun 11 22:56:58.418896 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:58.418862 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/init-config-reloader/0.log" Jun 11 22:56:58.619844 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:58.619813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/prometheus/0.log" Jun 11 22:56:58.823170 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:58.823143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/config-reloader/0.log" Jun 11 22:56:59.019376 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.019348 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/thanos-sidecar/0.log" Jun 11 22:56:59.218922 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.218848 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/kube-rbac-proxy-web/0.log" Jun 11 22:56:59.358520 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.358487 2574 patch_prober.go:28] interesting pod/image-registry-867c974c55-58nrt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:56:59.358687 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.358538 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:56:59.419219 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.419190 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/kube-rbac-proxy/0.log" Jun 11 22:56:59.624169 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:56:59.624140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f3539e0-84ce-435d-be94-c52767f39266/kube-rbac-proxy-thanos/0.log" Jun 11 22:57:01.618432 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:01.618406 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-mkt9h_9162cf6b-632a-481a-918b-6f42ecc96ef1/networking-console-plugin/0.log" Jun 11 22:57:04.219336 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:04.219309 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hl8kw_d17bb9ff-7f34-4864-ad31-49a434929a5c/dns-node-resolver/0.log" Jun 11 22:57:04.819642 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:04.819615 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-867c974c55-58nrt_9b953fe2-f885-491a-97d1-9717822cf456/registry/0.log" Jun 11 22:57:05.219149 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:05.219074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jt8sv_9c00acbb-c757-4694-afca-3489ab3075ce/node-ca/0.log" Jun 11 22:57:05.619638 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:05.619610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 22:57:06.018519 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:06.018440 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9cvs_e3dd3ec7-a97d-4605-beea-94558f91aacc/serve-healthcheck-canary/0.log" Jun 11 22:57:09.358641 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:09.358610 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:57:14.373933 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:14.373889 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-867c974c55-58nrt" podUID="9b953fe2-f885-491a-97d1-9717822cf456" containerName="registry" containerID="cri-o://1be76c16efae9dc57a219c70c808ec310f4f1a6b15966774e747b51a6dbf88f2" gracePeriod=30 Jun 11 22:57:15.687518 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:15.687482 2574 generic.go:356] "Generic (PLEG): container finished" podID="9b953fe2-f885-491a-97d1-9717822cf456" containerID="1be76c16efae9dc57a219c70c808ec310f4f1a6b15966774e747b51a6dbf88f2" exitCode=0 Jun 11 22:57:15.687518 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:15.687519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867c974c55-58nrt" event={"ID":"9b953fe2-f885-491a-97d1-9717822cf456","Type":"ContainerDied","Data":"1be76c16efae9dc57a219c70c808ec310f4f1a6b15966774e747b51a6dbf88f2"} Jun 11 22:57:15.687930 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:15.687554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867c974c55-58nrt" event={"ID":"9b953fe2-f885-491a-97d1-9717822cf456","Type":"ContainerStarted","Data":"0635b38c2c53e31026df8fbe63aec8b39cfbe41004859663e20bfcbb0df7d2a3"} Jun 11 22:57:15.687930 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:15.687669 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:57:17.253715 ip-10-0-142-124 kubenswrapper[2574]: E0611 22:57:17.253669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r8k6t" podUID="ae410fb1-2876-44ab-8d38-c921292c6084" Jun 11 22:57:17.696122 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:17.696084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:20.247037 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.246997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:20.249353 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.249335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae410fb1-2876-44ab-8d38-c921292c6084-metrics-tls\") pod \"dns-default-r8k6t\" (UID: \"ae410fb1-2876-44ab-8d38-c921292c6084\") " pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:20.400522 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.400498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9z2n\"" Jun 11 22:57:20.408113 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.408095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:20.530223 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.530184 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8k6t"] Jun 11 22:57:20.532407 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:57:20.532378 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae410fb1_2876_44ab_8d38_c921292c6084.slice/crio-e80fdd38661bdae561c73f070306c19426d776b56356cf13ec0fb82dc09c9052 WatchSource:0}: Error finding container e80fdd38661bdae561c73f070306c19426d776b56356cf13ec0fb82dc09c9052: Status 404 returned error can't find the container with id e80fdd38661bdae561c73f070306c19426d776b56356cf13ec0fb82dc09c9052 Jun 11 22:57:20.706839 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:20.706800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8k6t" event={"ID":"ae410fb1-2876-44ab-8d38-c921292c6084","Type":"ContainerStarted","Data":"e80fdd38661bdae561c73f070306c19426d776b56356cf13ec0fb82dc09c9052"} Jun 11 22:57:22.612656 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.612617 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:22.627950 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.627927 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:22.718725 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.718675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8k6t" event={"ID":"ae410fb1-2876-44ab-8d38-c921292c6084","Type":"ContainerStarted","Data":"7580514dfc3a279dcada08e128d2b1b83aaeae140b2ce58fc8a8f700059d3836"} Jun 11 22:57:22.718909 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.718746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8k6t" event={"ID":"ae410fb1-2876-44ab-8d38-c921292c6084","Type":"ContainerStarted","Data":"c5d065758a11d0587daafb51da963cf23ad91fb3655e8869fb10ccf76e2e1358"} Jun 11 22:57:22.719208 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.719193 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:22.734068 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.734045 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:22.736827 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:22.736784 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r8k6t" podStartSLOduration=251.340306573 podStartE2EDuration="4m12.736770727s" totalImagesPullingTime="1.396464154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:57:22.735947479 +0000 UTC m=+287.376933056" watchObservedRunningTime="2026-06-11 22:57:22.736770727 +0000 UTC m=+287.377756302" Jun 11 22:57:33.728427 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:33.728395 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r8k6t" Jun 11 22:57:35.751096 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:35.751063 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:57:35.754327 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:35.754303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 22:57:35.757775 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:35.757756 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 22:57:36.696463 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:36.696433 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-867c974c55-58nrt" Jun 11 22:57:40.630475 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630439 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:40.630867 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630753 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="prometheus" containerID="cri-o://973cbc346e41dea0adb4ace8f31dcca776659b835dc13643c8090c28f0928e75" gracePeriod=600 Jun 11 22:57:40.630867 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630765 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-web" containerID="cri-o://38ba194df83af7c0e00c8dc17203cc314a39da22458fa37cbff134b15a8354e1" gracePeriod=600 Jun 11 22:57:40.630867 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630798 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="config-reloader" containerID="cri-o://d4f2b1f43788b9d08693fdaf1e4fad22c5852c7bee7f1cd4916ef5102b93b96e" gracePeriod=600 Jun 11 22:57:40.631070 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630789 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy" containerID="cri-o://2f0ceb9f24601fc32885135855037da6e05bb60850d55327ffa3e9ad57d62df3" gracePeriod=600 Jun 11 22:57:40.631070 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630788 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="thanos-sidecar" containerID="cri-o://eff7ca9942f6740e63c2bcb3fcd37c031c18d5712dd6a81ab86cace73ab598ed" gracePeriod=600 Jun 11 22:57:40.631070 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.630832 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2acdacbc6fdddc3880376b3681e93cf2fa607a20d17d6ff1dfac1ffa5adfa0c0" gracePeriod=600 Jun 11 22:57:40.789281 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789248 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="2acdacbc6fdddc3880376b3681e93cf2fa607a20d17d6ff1dfac1ffa5adfa0c0" exitCode=0 Jun 11 22:57:40.789281 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789274 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="2f0ceb9f24601fc32885135855037da6e05bb60850d55327ffa3e9ad57d62df3" exitCode=0 Jun 11 22:57:40.789281 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789284 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="38ba194df83af7c0e00c8dc17203cc314a39da22458fa37cbff134b15a8354e1" exitCode=0 Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789292 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="eff7ca9942f6740e63c2bcb3fcd37c031c18d5712dd6a81ab86cace73ab598ed" exitCode=0 Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789298 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="d4f2b1f43788b9d08693fdaf1e4fad22c5852c7bee7f1cd4916ef5102b93b96e" exitCode=0 Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789303 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f3539e0-84ce-435d-be94-c52767f39266" containerID="973cbc346e41dea0adb4ace8f31dcca776659b835dc13643c8090c28f0928e75" exitCode=0 Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"2acdacbc6fdddc3880376b3681e93cf2fa607a20d17d6ff1dfac1ffa5adfa0c0"} Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"2f0ceb9f24601fc32885135855037da6e05bb60850d55327ffa3e9ad57d62df3"} Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"38ba194df83af7c0e00c8dc17203cc314a39da22458fa37cbff134b15a8354e1"} Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"eff7ca9942f6740e63c2bcb3fcd37c031c18d5712dd6a81ab86cace73ab598ed"} Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"d4f2b1f43788b9d08693fdaf1e4fad22c5852c7bee7f1cd4916ef5102b93b96e"} Jun 11 22:57:40.789504 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.789491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"973cbc346e41dea0adb4ace8f31dcca776659b835dc13643c8090c28f0928e75"} Jun 11 22:57:40.876168 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.876143 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:40.886667 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886622 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886667 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886657 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886667 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886674 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886690 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886711 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msv4f\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886742 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886767 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886832 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.886875 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886859 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886888 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886911 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886937 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.886963 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887000 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887060 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887089 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887115 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887142 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.887233 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887160 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887216 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2\") pod \"4f3539e0-84ce-435d-be94-c52767f39266\" (UID: \"4f3539e0-84ce-435d-be94-c52767f39266\") " Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887411 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887452 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887554 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887573 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-metrics-client-ca\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.887719 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887699 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.888053 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.887720 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.888287 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.888259 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.889873 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.889750 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:57:40.890127 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890082 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.890127 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890097 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f" (OuterVolumeSpecName: "kube-api-access-msv4f") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "kube-api-access-msv4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:40.890296 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890104 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.890511 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890473 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.890606 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890520 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config" (OuterVolumeSpecName: "config") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.890606 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890559 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.890606 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890587 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:40.890766 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890750 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out" (OuterVolumeSpecName: "config-out") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:57:40.890816 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890779 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.890870 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.890849 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.891931 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.891912 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.892255 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.892236 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.892534 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.892513 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:40.901747 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.901724 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config" (OuterVolumeSpecName: "web-config") pod "4f3539e0-84ce-435d-be94-c52767f39266" (UID: "4f3539e0-84ce-435d-be94-c52767f39266"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:40.988328 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988293 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988328 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988320 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-metrics-client-certs\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988328 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988333 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msv4f\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-kube-api-access-msv4f\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988344 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988353 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988361 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988371 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988379 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f3539e0-84ce-435d-be94-c52767f39266-tls-assets\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988387 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-config-out\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988395 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-db\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988403 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988412 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-kube-rbac-proxy\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988420 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-grpc-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988428 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-web-config\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988435 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f3539e0-84ce-435d-be94-c52767f39266-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988443 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:40.988550 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:40.988452 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f3539e0-84ce-435d-be94-c52767f39266-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 22:57:41.795956 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.795923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f3539e0-84ce-435d-be94-c52767f39266","Type":"ContainerDied","Data":"0cda2bdd5a2db3e180cd7e0c90df808ae9442d15d13d22474fca56a5498dccef"} Jun 11 22:57:41.795956 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.795959 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.796447 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.796007 2574 scope.go:117] "RemoveContainer" containerID="2acdacbc6fdddc3880376b3681e93cf2fa607a20d17d6ff1dfac1ffa5adfa0c0" Jun 11 22:57:41.804311 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.804173 2574 scope.go:117] "RemoveContainer" containerID="2f0ceb9f24601fc32885135855037da6e05bb60850d55327ffa3e9ad57d62df3" Jun 11 22:57:41.811232 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.811213 2574 scope.go:117] "RemoveContainer" containerID="38ba194df83af7c0e00c8dc17203cc314a39da22458fa37cbff134b15a8354e1" Jun 11 22:57:41.817531 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.817513 2574 scope.go:117] "RemoveContainer" containerID="eff7ca9942f6740e63c2bcb3fcd37c031c18d5712dd6a81ab86cace73ab598ed" Jun 11 22:57:41.822660 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.822637 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:41.824870 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.824851 2574 scope.go:117] "RemoveContainer" containerID="d4f2b1f43788b9d08693fdaf1e4fad22c5852c7bee7f1cd4916ef5102b93b96e" Jun 11 22:57:41.827336 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.827310 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:41.831950 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.831933 2574 scope.go:117] "RemoveContainer" containerID="973cbc346e41dea0adb4ace8f31dcca776659b835dc13643c8090c28f0928e75" Jun 11 22:57:41.839487 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.839469 2574 scope.go:117] "RemoveContainer" containerID="3447558774a40d1f2744ff5b5173385ad02255169ef94b3e8420586604eb374d" Jun 11 22:57:41.852872 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.852848 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:41.853117 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853104 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="init-config-reloader" Jun 11 22:57:41.853117 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853118 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="init-config-reloader" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853127 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="prometheus" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853133 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="prometheus" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853145 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-web" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853150 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-web" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853158 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="config-reloader" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853163 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="config-reloader" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853176 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853182 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853188 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="thanos-sidecar" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853193 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="thanos-sidecar" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853199 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy" Jun 11 22:57:41.853200 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853205 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853211 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-thanos" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853216 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-thanos" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853253 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="config-reloader" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853260 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853266 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="thanos-sidecar" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853272 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c008f4-a4a7-4b9e-9524-15f5c3689c12" containerName="registry" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853279 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-thanos" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853284 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="prometheus" Jun 11 22:57:41.853532 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.853290 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3539e0-84ce-435d-be94-c52767f39266" containerName="kube-rbac-proxy-web" Jun 11 22:57:41.858288 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.858273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.861399 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.861378 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9120p4mgfoteb\"" Jun 11 22:57:41.861638 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.861623 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 22:57:41.861725 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.861655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 22:57:41.861725 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.861711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wrx7h\"" Jun 11 22:57:41.861956 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.861938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 22:57:41.862207 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862187 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 22:57:41.862305 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862212 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 22:57:41.862305 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862240 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 22:57:41.862305 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 22:57:41.862305 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862300 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 22:57:41.862528 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862512 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 22:57:41.862589 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862517 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 22:57:41.862925 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 22:57:41.863001 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.862949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 22:57:41.863347 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.863333 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 22:57:41.866166 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.866147 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 22:57:41.868175 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.868159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 22:57:41.873673 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.873649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:41.894712 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.894577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.894916 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.894618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895087 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895399 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895399 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895609 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895609 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895800 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.895966 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.895910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896143 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896143 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896373 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g24vv\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-kube-api-access-g24vv\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896373 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896527 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896681 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896681 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.896928 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.896892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.897115 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.897041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.897115 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.897073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999751 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999751 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g24vv\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-kube-api-access-g24vv\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:41.999997 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:41.999980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000371 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000917 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000917 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.000917 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.000862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.001874 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.001532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.002705 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.002224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.002705 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.002473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.002705 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.002660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.003665 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.003637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a1cca36-310d-4319-b699-70a2c5788aa0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.004157 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.004130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.004730 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.004696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.005269 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.005243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.005495 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.005437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006313 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.005736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006313 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.006265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006462 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.006375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006462 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.006402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006462 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.006424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a1cca36-310d-4319-b699-70a2c5788aa0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.006833 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.006811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a1cca36-310d-4319-b699-70a2c5788aa0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.007273 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.007254 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.022002 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.021981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g24vv\" (UniqueName: \"kubernetes.io/projected/5a1cca36-310d-4319-b699-70a2c5788aa0-kube-api-access-g24vv\") pod \"prometheus-k8s-0\" (UID: \"5a1cca36-310d-4319-b699-70a2c5788aa0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.167548 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.167466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:57:42.311823 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.311792 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 22:57:42.312751 ip-10-0-142-124 kubenswrapper[2574]: W0611 22:57:42.312722 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1cca36_310d_4319_b699_70a2c5788aa0.slice/crio-491da3cdcb9bbb2bc05b220088f7b2f378bc809aa61442701d96eea12d044a6e WatchSource:0}: Error finding container 491da3cdcb9bbb2bc05b220088f7b2f378bc809aa61442701d96eea12d044a6e: Status 404 returned error can't find the container with id 491da3cdcb9bbb2bc05b220088f7b2f378bc809aa61442701d96eea12d044a6e Jun 11 22:57:42.802236 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.802202 2574 generic.go:356] "Generic (PLEG): container finished" podID="5a1cca36-310d-4319-b699-70a2c5788aa0" containerID="30449b9935b0e713f55b5e20e291e2e752f04457f8cb1b400b4d01e586a63aa9" exitCode=0 Jun 11 22:57:42.802648 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.802239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerDied","Data":"30449b9935b0e713f55b5e20e291e2e752f04457f8cb1b400b4d01e586a63aa9"} Jun 11 22:57:42.802648 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:42.802305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"491da3cdcb9bbb2bc05b220088f7b2f378bc809aa61442701d96eea12d044a6e"} Jun 11 22:57:43.802423 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.802389 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3539e0-84ce-435d-be94-c52767f39266" path="/var/lib/kubelet/pods/4f3539e0-84ce-435d-be94-c52767f39266/volumes" Jun 11 22:57:43.812124 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"0093cb2c5c9a4450d63512913fc3fbb8d1d25e5f382412f1cf982e85914f1c75"} Jun 11 22:57:43.812258 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"4aa6a66b943bd5d4b441826720746fcdc22695fc4bdaef72b733f0fc7374ed10"} Jun 11 22:57:43.812258 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"4dd0d5fafb6deb3b35eb2a576850440d96a5cdcf555366f6786856deff6ca763"} Jun 11 22:57:43.812258 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"b3c8e6940df17eb534a6faf873148623204e8ca7deab0bd1a27cbbe5e40ea886"} Jun 11 22:57:43.812258 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812234 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"cea393c59ac79dedf0e4304e0b9bca92b9c04932cc568b6bad08f46cff84c7e0"} Jun 11 22:57:43.812258 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.812256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a1cca36-310d-4319-b699-70a2c5788aa0","Type":"ContainerStarted","Data":"0852b7ebd95b048aa9d1541ab0b5efda174486637249487a3b728fc1dccc4837"} Jun 11 22:57:43.866953 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:43.866695 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.847680449 podStartE2EDuration="2.866673584s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.993135ms" isStatefulPod=false podCreationTimestamp="2026-06-11 22:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:57:43.864065159 +0000 UTC m=+308.505050738" watchObservedRunningTime="2026-06-11 22:57:43.866673584 +0000 UTC m=+308.507659161" Jun 11 22:57:47.168494 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:57:47.168446 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:58:42.168098 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:58:42.168056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:58:42.184145 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:58:42.184107 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 22:58:43.040614 ip-10-0-142-124 kubenswrapper[2574]: I0611 22:58:43.040587 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:00:43.125449 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.125417 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp"] Jun 11 23:00:43.128609 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.128592 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.132714 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.132692 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:00:43.133106 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.133083 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:00:43.133174 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.133116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:00:43.134293 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.134269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bv85g\"" Jun 11 23:00:43.134415 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.134309 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:00:43.158147 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.158114 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp"] Jun 11 23:00:43.252335 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.252295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.252512 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.252346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ktc2\" (UniqueName: \"kubernetes.io/projected/32464d76-018f-44bf-b8b4-4c99ce41c6f7-kube-api-access-5ktc2\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.252512 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.252422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.252512 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.252495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.252619 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.252527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.353630 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.353630 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.353889 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ktc2\" (UniqueName: \"kubernetes.io/projected/32464d76-018f-44bf-b8b4-4c99ce41c6f7-kube-api-access-5ktc2\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.353889 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.353889 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.354073 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.353997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.356154 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.356120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32464d76-018f-44bf-b8b4-4c99ce41c6f7-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.356301 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.356185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.356403 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.356385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32464d76-018f-44bf-b8b4-4c99ce41c6f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.361783 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.361764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ktc2\" (UniqueName: \"kubernetes.io/projected/32464d76-018f-44bf-b8b4-4c99ce41c6f7-kube-api-access-5ktc2\") pod \"opendatahub-operator-controller-manager-74f864d649-8k7tp\" (UID: \"32464d76-018f-44bf-b8b4-4c99ce41c6f7\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.439855 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.439778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:43.570309 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.570285 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp"] Jun 11 23:00:43.573202 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:00:43.573168 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32464d76_018f_44bf_b8b4_4c99ce41c6f7.slice/crio-95c0d7b1b7516f1d2cede6155df280dd43cc9d515bc59990363c52977beee1b1 WatchSource:0}: Error finding container 95c0d7b1b7516f1d2cede6155df280dd43cc9d515bc59990363c52977beee1b1: Status 404 returned error can't find the container with id 95c0d7b1b7516f1d2cede6155df280dd43cc9d515bc59990363c52977beee1b1 Jun 11 23:00:43.575092 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:43.575075 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:00:44.467751 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:44.467705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" event={"ID":"32464d76-018f-44bf-b8b4-4c99ce41c6f7","Type":"ContainerStarted","Data":"95c0d7b1b7516f1d2cede6155df280dd43cc9d515bc59990363c52977beee1b1"} Jun 11 23:00:47.482737 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:47.482702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" event={"ID":"32464d76-018f-44bf-b8b4-4c99ce41c6f7","Type":"ContainerStarted","Data":"4e9266c372ba1b90a11d97d8b862ca2f6ec65de029e59bd9978a074e115afacf"} Jun 11 23:00:48.488177 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:48.488143 2574 generic.go:356] "Generic (PLEG): container finished" podID="32464d76-018f-44bf-b8b4-4c99ce41c6f7" containerID="4e9266c372ba1b90a11d97d8b862ca2f6ec65de029e59bd9978a074e115afacf" exitCode=0 Jun 11 23:00:48.488635 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:48.488233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" event={"ID":"32464d76-018f-44bf-b8b4-4c99ce41c6f7","Type":"ContainerDied","Data":"4e9266c372ba1b90a11d97d8b862ca2f6ec65de029e59bd9978a074e115afacf"} Jun 11 23:00:49.494106 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:49.494072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" event={"ID":"32464d76-018f-44bf-b8b4-4c99ce41c6f7","Type":"ContainerStarted","Data":"ebbff3f1d85fe68495a31b9e95523ac79878722b8cc0211812fc6a026ae7b8cb"} Jun 11 23:00:49.494481 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:49.494161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:00:49.518316 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:00:49.518260 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" podStartSLOduration=1.970741833 podStartE2EDuration="6.518242825s" totalImagesPullingTime="3.568665013s" totalInitContainerRuntime="978.835979ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:49.515670759 +0000 UTC m=+494.156656358" watchObservedRunningTime="2026-06-11 23:00:49.518242825 +0000 UTC m=+494.159228401" Jun 11 23:01:00.500150 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:00.500121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-8k7tp" Jun 11 23:01:02.798221 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.798183 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c495b869c-7fch9"] Jun 11 23:01:02.805800 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.805773 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.808967 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.808941 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 23:01:02.810340 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.810317 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 23:01:02.810340 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.810332 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v6gzp\"" Jun 11 23:01:02.819164 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.819144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c495b869c-7fch9"] Jun 11 23:01:02.897729 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.897697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2a96a9-bc85-40f5-9161-d8c05361a324-tls-certs\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.897729 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.897731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs9tw\" (UniqueName: \"kubernetes.io/projected/5f2a96a9-bc85-40f5-9161-d8c05361a324-kube-api-access-qs9tw\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.897931 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.897759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2a96a9-bc85-40f5-9161-d8c05361a324-tmp\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.999205 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.999168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2a96a9-bc85-40f5-9161-d8c05361a324-tls-certs\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.999391 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.999211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs9tw\" (UniqueName: \"kubernetes.io/projected/5f2a96a9-bc85-40f5-9161-d8c05361a324-kube-api-access-qs9tw\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:02.999391 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:02.999240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2a96a9-bc85-40f5-9161-d8c05361a324-tmp\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:03.001511 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.001488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2a96a9-bc85-40f5-9161-d8c05361a324-tmp\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:03.001760 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.001740 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2a96a9-bc85-40f5-9161-d8c05361a324-tls-certs\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:03.008798 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.008769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs9tw\" (UniqueName: \"kubernetes.io/projected/5f2a96a9-bc85-40f5-9161-d8c05361a324-kube-api-access-qs9tw\") pod \"kube-auth-proxy-5c495b869c-7fch9\" (UID: \"5f2a96a9-bc85-40f5-9161-d8c05361a324\") " pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:03.114908 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.114871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" Jun 11 23:01:03.249470 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.249373 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c495b869c-7fch9"] Jun 11 23:01:03.251649 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:01:03.251621 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2a96a9_bc85_40f5_9161_d8c05361a324.slice/crio-8c44ebc7007d52179bc316cfa627826d855cbe1ea808d77b666afb3328d71a77 WatchSource:0}: Error finding container 8c44ebc7007d52179bc316cfa627826d855cbe1ea808d77b666afb3328d71a77: Status 404 returned error can't find the container with id 8c44ebc7007d52179bc316cfa627826d855cbe1ea808d77b666afb3328d71a77 Jun 11 23:01:03.368055 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.367947 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-x8qqv"] Jun 11 23:01:03.370673 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.370658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.374429 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.374409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 23:01:03.374725 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.374711 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:01:03.374773 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.374722 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 23:01:03.374995 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.374980 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:01:03.376087 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.376074 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vtzkl\"" Jun 11 23:01:03.376162 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.376123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 23:01:03.383229 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.383208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-x8qqv"] Jun 11 23:01:03.402658 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.402636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da352b7a-b838-42bb-9b04-155fd35e2802-manager-config\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.402750 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.402703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-metrics-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.402794 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.402762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.402794 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.402780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r9b5\" (UniqueName: \"kubernetes.io/projected/da352b7a-b838-42bb-9b04-155fd35e2802-kube-api-access-2r9b5\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.503400 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.503364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-metrics-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.503595 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.503422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.503595 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.503439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r9b5\" (UniqueName: \"kubernetes.io/projected/da352b7a-b838-42bb-9b04-155fd35e2802-kube-api-access-2r9b5\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.503595 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.503478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da352b7a-b838-42bb-9b04-155fd35e2802-manager-config\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.504082 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.504058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da352b7a-b838-42bb-9b04-155fd35e2802-manager-config\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.506525 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.506494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.506612 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.506502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da352b7a-b838-42bb-9b04-155fd35e2802-metrics-cert\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.512709 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.512679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r9b5\" (UniqueName: \"kubernetes.io/projected/da352b7a-b838-42bb-9b04-155fd35e2802-kube-api-access-2r9b5\") pod \"lws-controller-manager-856696d794-x8qqv\" (UID: \"da352b7a-b838-42bb-9b04-155fd35e2802\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.548343 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.548316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" event={"ID":"5f2a96a9-bc85-40f5-9161-d8c05361a324","Type":"ContainerStarted","Data":"8c44ebc7007d52179bc316cfa627826d855cbe1ea808d77b666afb3328d71a77"} Jun 11 23:01:03.680557 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.680463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:03.810043 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:03.810001 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-x8qqv"] Jun 11 23:01:03.812889 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:01:03.812859 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda352b7a_b838_42bb_9b04_155fd35e2802.slice/crio-a045ef1eb30403056cd93bd4f5ab7f8747d34c2bed194c114f0887aa0eb9506c WatchSource:0}: Error finding container a045ef1eb30403056cd93bd4f5ab7f8747d34c2bed194c114f0887aa0eb9506c: Status 404 returned error can't find the container with id a045ef1eb30403056cd93bd4f5ab7f8747d34c2bed194c114f0887aa0eb9506c Jun 11 23:01:04.553585 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:04.553546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" event={"ID":"da352b7a-b838-42bb-9b04-155fd35e2802","Type":"ContainerStarted","Data":"a045ef1eb30403056cd93bd4f5ab7f8747d34c2bed194c114f0887aa0eb9506c"} Jun 11 23:01:06.565816 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:06.565775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" event={"ID":"5f2a96a9-bc85-40f5-9161-d8c05361a324","Type":"ContainerStarted","Data":"2ba677591cff4ab4d13da8c3196b11fb5d3ebfc5a232d7035a97818b8d32f4dc"} Jun 11 23:01:06.586504 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:06.586450 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c495b869c-7fch9" podStartSLOduration=1.94455819 podStartE2EDuration="4.586434079s" totalImagesPullingTime="2.641875889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:01:06.583745759 +0000 UTC m=+511.224731336" watchObservedRunningTime="2026-06-11 23:01:06.586434079 +0000 UTC m=+511.227419682" Jun 11 23:01:08.575075 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:08.575012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" event={"ID":"da352b7a-b838-42bb-9b04-155fd35e2802","Type":"ContainerStarted","Data":"7915622edee750f4162aae433065bbc07de3d968b0638ef38d82ae55bc69aa05"} Jun 11 23:01:08.575479 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:08.575126 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:01:08.598370 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:08.598316 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" podStartSLOduration=1.159762707 podStartE2EDuration="5.598301014s" totalImagesPullingTime="4.438538307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:01:08.595741998 +0000 UTC m=+513.236727575" watchObservedRunningTime="2026-06-11 23:01:08.598301014 +0000 UTC m=+513.239286589" Jun 11 23:01:19.581427 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:01:19.581398 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856696d794-x8qqv" Jun 11 23:02:35.776427 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:02:35.776395 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:02:35.777769 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:02:35.777747 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:03:00.674147 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.674063 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r"] Jun 11 23:03:00.676235 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.676219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.681674 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.681647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 23:03:00.681960 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.681936 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 23:03:00.682237 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.682212 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jzsps\"" Jun 11 23:03:00.683307 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.683284 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:03:00.683401 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.683361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:03:00.700623 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.700589 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r"] Jun 11 23:03:00.794267 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.794228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwfkm\" (UniqueName: \"kubernetes.io/projected/4987f9ec-664a-44a3-813f-5cd810e641cf-kube-api-access-cwfkm\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.794267 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.794271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4987f9ec-664a-44a3-813f-5cd810e641cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.794480 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.794369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.895506 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.895472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwfkm\" (UniqueName: \"kubernetes.io/projected/4987f9ec-664a-44a3-813f-5cd810e641cf-kube-api-access-cwfkm\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.895506 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.895513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4987f9ec-664a-44a3-813f-5cd810e641cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.895737 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.895709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.895815 ip-10-0-142-124 kubenswrapper[2574]: E0611 23:03:00.895797 2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 23:03:00.895885 ip-10-0-142-124 kubenswrapper[2574]: E0611 23:03:00.895874 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert podName:4987f9ec-664a-44a3-813f-5cd810e641cf nodeName:}" failed. No retries permitted until 2026-06-11 23:03:01.395856363 +0000 UTC m=+626.036841917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-mbh8r" (UID: "4987f9ec-664a-44a3-813f-5cd810e641cf") : secret "plugin-serving-cert" not found Jun 11 23:03:00.896104 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.896088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4987f9ec-664a-44a3-813f-5cd810e641cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:00.910038 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:00.910004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwfkm\" (UniqueName: \"kubernetes.io/projected/4987f9ec-664a-44a3-813f-5cd810e641cf-kube-api-access-cwfkm\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:01.398612 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:01.398574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:01.401005 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:01.400981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4987f9ec-664a-44a3-813f-5cd810e641cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbh8r\" (UID: \"4987f9ec-664a-44a3-813f-5cd810e641cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:01.589053 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:01.588994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" Jun 11 23:03:01.725766 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:01.725742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r"] Jun 11 23:03:01.728171 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:03:01.728142 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4987f9ec_664a_44a3_813f_5cd810e641cf.slice/crio-4392e1265884863dc819b53acc69edb3b6a11faf6d4f4174288ac0ac2a831681 WatchSource:0}: Error finding container 4392e1265884863dc819b53acc69edb3b6a11faf6d4f4174288ac0ac2a831681: Status 404 returned error can't find the container with id 4392e1265884863dc819b53acc69edb3b6a11faf6d4f4174288ac0ac2a831681 Jun 11 23:03:01.993386 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:01.993293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" event={"ID":"4987f9ec-664a-44a3-813f-5cd810e641cf","Type":"ContainerStarted","Data":"4392e1265884863dc819b53acc69edb3b6a11faf6d4f4174288ac0ac2a831681"} Jun 11 23:03:10.683996 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.683952 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g"] Jun 11 23:03:10.687204 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.686832 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.691239 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.691214 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fhlt6\"" Jun 11 23:03:10.719538 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.719510 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g"] Jun 11 23:03:10.787181 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.787140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ll5h\" (UniqueName: \"kubernetes.io/projected/c778a567-b55a-465e-a012-5280c072c649-kube-api-access-9ll5h\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.787343 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.787219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c778a567-b55a-465e-a012-5280c072c649-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.888230 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.888189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c778a567-b55a-465e-a012-5280c072c649-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.888418 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.888291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ll5h\" (UniqueName: \"kubernetes.io/projected/c778a567-b55a-465e-a012-5280c072c649-kube-api-access-9ll5h\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.888611 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.888586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c778a567-b55a-465e-a012-5280c072c649-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.903337 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.903310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ll5h\" (UniqueName: \"kubernetes.io/projected/c778a567-b55a-465e-a012-5280c072c649-kube-api-access-9ll5h\") pod \"kuadrant-operator-controller-manager-86878c769f-kx87g\" (UID: \"c778a567-b55a-465e-a012-5280c072c649\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:10.999151 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:10.999071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:25.620327 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:25.620297 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g"] Jun 11 23:03:25.621360 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:03:25.621332 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc778a567_b55a_465e_a012_5280c072c649.slice/crio-f4c29bd3a7d6efa80370262cf3e70f318856f0cc82ae82f299797149d22ed242 WatchSource:0}: Error finding container f4c29bd3a7d6efa80370262cf3e70f318856f0cc82ae82f299797149d22ed242: Status 404 returned error can't find the container with id f4c29bd3a7d6efa80370262cf3e70f318856f0cc82ae82f299797149d22ed242 Jun 11 23:03:26.100729 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:26.100691 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" event={"ID":"4987f9ec-664a-44a3-813f-5cd810e641cf","Type":"ContainerStarted","Data":"3d65c65268987324ce8662cbe4c19ae83d8953c6e1fc58e54eac8a6fa5ef2fe4"} Jun 11 23:03:26.101950 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:26.101916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" event={"ID":"c778a567-b55a-465e-a012-5280c072c649","Type":"ContainerStarted","Data":"f4c29bd3a7d6efa80370262cf3e70f318856f0cc82ae82f299797149d22ed242"} Jun 11 23:03:26.119014 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:26.118965 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbh8r" podStartSLOduration=1.932954526 podStartE2EDuration="26.11895103s" totalImagesPullingTime="24.185996504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:03:26.117694953 +0000 UTC m=+650.758680530" watchObservedRunningTime="2026-06-11 23:03:26.11895103 +0000 UTC m=+650.759936605" Jun 11 23:03:33.134676 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:33.134644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" event={"ID":"c778a567-b55a-465e-a012-5280c072c649","Type":"ContainerStarted","Data":"af2bb238dcf0d99bd2d7a4255602d81dda9b0fec6b9ad254ce226cb944d20924"} Jun 11 23:03:33.135186 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:33.134756 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:44.141661 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:44.141627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" Jun 11 23:03:44.164608 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:03:44.164551 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kx87g" podStartSLOduration=26.764117198 podStartE2EDuration="34.164534593s" totalImagesPullingTime="7.400417395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:03:33.176880987 +0000 UTC m=+657.817866564" watchObservedRunningTime="2026-06-11 23:03:44.164534593 +0000 UTC m=+668.805520226" Jun 11 23:04:03.772800 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:03.772764 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:03.825037 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:03.824985 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:03.825206 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:03.825142 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:03.828689 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:03.828664 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m779d\"" Jun 11 23:04:03.968402 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:03.968358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6868b\" (UniqueName: \"kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b\") pod \"authorino-58cd955675-9hwxg\" (UID: \"e180756e-6c63-4dc4-b3f9-9020acaa24d9\") " pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:04.069482 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:04.069440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6868b\" (UniqueName: \"kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b\") pod \"authorino-58cd955675-9hwxg\" (UID: \"e180756e-6c63-4dc4-b3f9-9020acaa24d9\") " pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:04.079166 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:04.079140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6868b\" (UniqueName: \"kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b\") pod \"authorino-58cd955675-9hwxg\" (UID: \"e180756e-6c63-4dc4-b3f9-9020acaa24d9\") " pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:04.136960 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:04.136925 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:04.269587 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:04.269562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:04.272237 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:04:04.272209 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode180756e_6c63_4dc4_b3f9_9020acaa24d9.slice/crio-6dfc7c52dbbb47930913645d8b137e3bfe53b06eb0740b2779066df4391e544a WatchSource:0}: Error finding container 6dfc7c52dbbb47930913645d8b137e3bfe53b06eb0740b2779066df4391e544a: Status 404 returned error can't find the container with id 6dfc7c52dbbb47930913645d8b137e3bfe53b06eb0740b2779066df4391e544a Jun 11 23:04:05.271005 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:05.270964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hwxg" event={"ID":"e180756e-6c63-4dc4-b3f9-9020acaa24d9","Type":"ContainerStarted","Data":"6dfc7c52dbbb47930913645d8b137e3bfe53b06eb0740b2779066df4391e544a"} Jun 11 23:04:08.286343 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:08.286307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hwxg" event={"ID":"e180756e-6c63-4dc4-b3f9-9020acaa24d9","Type":"ContainerStarted","Data":"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b"} Jun 11 23:04:08.302755 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:08.302706 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9hwxg" podStartSLOduration=1.981358124 podStartE2EDuration="5.302689283s" totalImagesPullingTime="3.321331159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:04:08.301484934 +0000 UTC m=+692.942470528" watchObservedRunningTime="2026-06-11 23:04:08.302689283 +0000 UTC m=+692.943674859" Jun 11 23:04:09.020626 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:09.020586 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:10.294874 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:10.294815 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9hwxg" podUID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" containerName="authorino" containerID="cri-o://4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b" gracePeriod=30 Jun 11 23:04:10.539824 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:10.539800 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:10.623315 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:10.623277 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6868b\" (UniqueName: \"kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b\") pod \"e180756e-6c63-4dc4-b3f9-9020acaa24d9\" (UID: \"e180756e-6c63-4dc4-b3f9-9020acaa24d9\") " Jun 11 23:04:10.625517 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:10.625490 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b" (OuterVolumeSpecName: "kube-api-access-6868b") pod "e180756e-6c63-4dc4-b3f9-9020acaa24d9" (UID: "e180756e-6c63-4dc4-b3f9-9020acaa24d9"). InnerVolumeSpecName "kube-api-access-6868b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:04:10.724462 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:10.724428 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6868b\" (UniqueName: \"kubernetes.io/projected/e180756e-6c63-4dc4-b3f9-9020acaa24d9-kube-api-access-6868b\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 23:04:11.299506 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.299468 2574 generic.go:356] "Generic (PLEG): container finished" podID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" containerID="4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b" exitCode=0 Jun 11 23:04:11.299506 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.299511 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hwxg" Jun 11 23:04:11.299997 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.299544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hwxg" event={"ID":"e180756e-6c63-4dc4-b3f9-9020acaa24d9","Type":"ContainerDied","Data":"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b"} Jun 11 23:04:11.299997 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.299589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hwxg" event={"ID":"e180756e-6c63-4dc4-b3f9-9020acaa24d9","Type":"ContainerDied","Data":"6dfc7c52dbbb47930913645d8b137e3bfe53b06eb0740b2779066df4391e544a"} Jun 11 23:04:11.299997 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.299605 2574 scope.go:117] "RemoveContainer" containerID="4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b" Jun 11 23:04:11.307908 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.307883 2574 scope.go:117] "RemoveContainer" containerID="4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b" Jun 11 23:04:11.308202 ip-10-0-142-124 kubenswrapper[2574]: E0611 23:04:11.308181 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b\": container with ID starting with 4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b not found: ID does not exist" containerID="4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b" Jun 11 23:04:11.308254 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.308210 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b"} err="failed to get container status \"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b\": rpc error: code = NotFound desc = could not find container \"4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b\": container with ID starting with 4be27a7804c9250ed24eebccf24a345fd18eea3a4711eba32cb857ac9fb3813b not found: ID does not exist" Jun 11 23:04:11.320515 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.320491 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:11.324064 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.324043 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hwxg"] Jun 11 23:04:11.801811 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:04:11.801773 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" path="/var/lib/kubelet/pods/e180756e-6c63-4dc4-b3f9-9020acaa24d9/volumes" Jun 11 23:05:00.866397 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.866362 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:05:00.866814 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.866669 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" containerName="authorino" Jun 11 23:05:00.866814 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.866680 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" containerName="authorino" Jun 11 23:05:00.866814 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.866733 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e180756e-6c63-4dc4-b3f9-9020acaa24d9" containerName="authorino" Jun 11 23:05:00.868962 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.868944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:00.872254 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.872231 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:05:00.872389 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.872262 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:05:00.873797 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.873780 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sj7t2\"" Jun 11 23:05:00.873797 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.873789 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 23:05:00.880017 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:00.879992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:05:01.044664 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.044633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmqt\" (UniqueName: \"kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt\") pod \"maas-keycloak-0\" (UID: \"f016ba9e-f0b6-4232-988c-622e5941b750\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:01.145712 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.145620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmqt\" (UniqueName: \"kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt\") pod \"maas-keycloak-0\" (UID: \"f016ba9e-f0b6-4232-988c-622e5941b750\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:01.156224 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.156197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmqt\" (UniqueName: \"kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt\") pod \"maas-keycloak-0\" (UID: \"f016ba9e-f0b6-4232-988c-622e5941b750\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:01.177996 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.177965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:01.310402 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.310376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:05:01.312842 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:05:01.312813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf016ba9e_f0b6_4232_988c_622e5941b750.slice/crio-cf32af2931235ab8ef422287709ba73f3be613bf366a4a2d890a0570b88f0242 WatchSource:0}: Error finding container cf32af2931235ab8ef422287709ba73f3be613bf366a4a2d890a0570b88f0242: Status 404 returned error can't find the container with id cf32af2931235ab8ef422287709ba73f3be613bf366a4a2d890a0570b88f0242 Jun 11 23:05:01.505750 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:01.505665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f016ba9e-f0b6-4232-988c-622e5941b750","Type":"ContainerStarted","Data":"cf32af2931235ab8ef422287709ba73f3be613bf366a4a2d890a0570b88f0242"} Jun 11 23:05:08.539976 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:08.539939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f016ba9e-f0b6-4232-988c-622e5941b750","Type":"ContainerStarted","Data":"59fc4ddf69df0bfce236f85e4c1413d36240dc798408f730bdb6df3f2c87cd6d"} Jun 11 23:05:08.561898 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:08.561849 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9688099970000001 podStartE2EDuration="8.561835233s" totalImagesPullingTime="6.593025236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:05:08.560602364 +0000 UTC m=+753.201587939" watchObservedRunningTime="2026-06-11 23:05:08.561835233 +0000 UTC m=+753.202820809" Jun 11 23:05:09.178472 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:09.178425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:09.180204 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:09.180175 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:10.178891 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:10.178835 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:11.178245 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:11.178180 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:11.178521 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:11.178479 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:12.179441 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:12.179392 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:13.179534 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:13.179086 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:14.178971 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:14.178881 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:15.179369 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:15.179317 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:16.178745 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:16.178692 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:17.179474 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:17.179430 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:18.178677 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:18.178629 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:19.178867 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:19.178822 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:20.179111 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:20.179062 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused" Jun 11 23:05:21.294941 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:21.294877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:21.308465 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:21.308397 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:05:31.302501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:31.302465 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:05:32.517577 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.517541 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:05:32.523834 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.523811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.528628 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.528602 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m779d\"" Jun 11 23:05:32.528759 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.528653 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 23:05:32.530826 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.530762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:05:32.646693 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.646656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.646882 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.646706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wf9\" (UniqueName: \"kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.747443 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.747403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wf9\" (UniqueName: \"kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.747615 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.747485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.749971 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.749949 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.755804 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.755778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wf9\" (UniqueName: \"kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9\") pod \"authorino-696747655d-cbhp2\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.833899 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.833865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:05:32.960805 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:32.960782 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:05:32.962718 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:05:32.962689 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4017eb28_53d5_426d_adee_cc9b518d1590.slice/crio-6e7f8cd0a6de406fc27057db87fb5427cfef0d632b22c6383a6bcdbeb48b60e6 WatchSource:0}: Error finding container 6e7f8cd0a6de406fc27057db87fb5427cfef0d632b22c6383a6bcdbeb48b60e6: Status 404 returned error can't find the container with id 6e7f8cd0a6de406fc27057db87fb5427cfef0d632b22c6383a6bcdbeb48b60e6 Jun 11 23:05:33.681443 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:33.681334 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696747655d-cbhp2" event={"ID":"4017eb28-53d5-426d-adee-cc9b518d1590","Type":"ContainerStarted","Data":"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35"} Jun 11 23:05:33.681443 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:33.681392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696747655d-cbhp2" event={"ID":"4017eb28-53d5-426d-adee-cc9b518d1590","Type":"ContainerStarted","Data":"6e7f8cd0a6de406fc27057db87fb5427cfef0d632b22c6383a6bcdbeb48b60e6"} Jun 11 23:05:33.700978 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:05:33.700927 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-696747655d-cbhp2" podStartSLOduration=1.36256136 podStartE2EDuration="1.700910335s" totalImagesPullingTime="338.348975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:05:33.698454687 +0000 UTC m=+778.339440262" watchObservedRunningTime="2026-06-11 23:05:33.700910335 +0000 UTC m=+778.341895910" Jun 11 23:06:21.054369 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:21.054329 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:21.054860 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:21.054561 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" containerID="cri-o://59fc4ddf69df0bfce236f85e4c1413d36240dc798408f730bdb6df3f2c87cd6d" gracePeriod=30 Jun 11 23:06:21.300122 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:21.300073 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:06:22.893484 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:22.893448 2574 generic.go:356] "Generic (PLEG): container finished" podID="f016ba9e-f0b6-4232-988c-622e5941b750" containerID="59fc4ddf69df0bfce236f85e4c1413d36240dc798408f730bdb6df3f2c87cd6d" exitCode=143 Jun 11 23:06:22.893982 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:22.893524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f016ba9e-f0b6-4232-988c-622e5941b750","Type":"ContainerDied","Data":"59fc4ddf69df0bfce236f85e4c1413d36240dc798408f730bdb6df3f2c87cd6d"} Jun 11 23:06:23.093085 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.093050 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:23.172311 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.172221 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kmqt\" (UniqueName: \"kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt\") pod \"f016ba9e-f0b6-4232-988c-622e5941b750\" (UID: \"f016ba9e-f0b6-4232-988c-622e5941b750\") " Jun 11 23:06:23.174477 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.174446 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt" (OuterVolumeSpecName: "kube-api-access-4kmqt") pod "f016ba9e-f0b6-4232-988c-622e5941b750" (UID: "f016ba9e-f0b6-4232-988c-622e5941b750"). InnerVolumeSpecName "kube-api-access-4kmqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:06:23.273562 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.273519 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kmqt\" (UniqueName: \"kubernetes.io/projected/f016ba9e-f0b6-4232-988c-622e5941b750-kube-api-access-4kmqt\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 23:06:23.899419 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.899388 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:23.899419 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.899405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f016ba9e-f0b6-4232-988c-622e5941b750","Type":"ContainerDied","Data":"cf32af2931235ab8ef422287709ba73f3be613bf366a4a2d890a0570b88f0242"} Jun 11 23:06:23.899927 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.899458 2574 scope.go:117] "RemoveContainer" containerID="59fc4ddf69df0bfce236f85e4c1413d36240dc798408f730bdb6df3f2c87cd6d" Jun 11 23:06:23.918996 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.918971 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:23.922736 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.922711 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:23.945856 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.945827 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:23.946149 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.946135 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" Jun 11 23:06:23.946197 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.946151 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" Jun 11 23:06:23.946232 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.946207 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" containerName="keycloak" Jun 11 23:06:23.950534 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.950517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:23.953871 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.953850 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:06:23.954101 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.954081 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sj7t2\"" Jun 11 23:06:23.954101 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.954101 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 23:06:23.954290 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.954139 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:06:23.954290 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.954085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 23:06:23.959396 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:23.959363 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:24.082568 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.082483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-test-realms\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.082568 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.082559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gncl5\" (UniqueName: \"kubernetes.io/projected/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-kube-api-access-gncl5\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.183569 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.183530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gncl5\" (UniqueName: \"kubernetes.io/projected/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-kube-api-access-gncl5\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.183716 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.183612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-test-realms\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.184363 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.184345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-test-realms\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.194037 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.194006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gncl5\" (UniqueName: \"kubernetes.io/projected/2f9f9ae3-af01-4378-87f1-7a5c66df9af9-kube-api-access-gncl5\") pod \"maas-keycloak-0\" (UID: \"2f9f9ae3-af01-4378-87f1-7a5c66df9af9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.260737 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.260703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:24.392775 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.392751 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:06:24.394894 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:06:24.394865 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9f9ae3_af01_4378_87f1_7a5c66df9af9.slice/crio-bf0df74857b8c8fdba2b8f3f7a99fbdf66f080fdc92be77ac1a3dce073047a0e WatchSource:0}: Error finding container bf0df74857b8c8fdba2b8f3f7a99fbdf66f080fdc92be77ac1a3dce073047a0e: Status 404 returned error can't find the container with id bf0df74857b8c8fdba2b8f3f7a99fbdf66f080fdc92be77ac1a3dce073047a0e Jun 11 23:06:24.396750 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.396729 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:06:24.906400 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.906366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f9f9ae3-af01-4378-87f1-7a5c66df9af9","Type":"ContainerStarted","Data":"38dabb72b252951e7f9ea9a1fbc6994326fd99192194b1a3ba5cf8a5d25df301"} Jun 11 23:06:24.906761 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.906413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f9f9ae3-af01-4378-87f1-7a5c66df9af9","Type":"ContainerStarted","Data":"bf0df74857b8c8fdba2b8f3f7a99fbdf66f080fdc92be77ac1a3dce073047a0e"} Jun 11 23:06:24.928694 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:24.928648 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5805316550000001 podStartE2EDuration="1.928632724s" totalImagesPullingTime="348.101069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:06:24.926916299 +0000 UTC m=+829.567901875" watchObservedRunningTime="2026-06-11 23:06:24.928632724 +0000 UTC m=+829.569618300" Jun 11 23:06:25.261534 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:25.261482 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:25.263322 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:25.263276 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:25.805416 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:25.805375 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f016ba9e-f0b6-4232-988c-622e5941b750" path="/var/lib/kubelet/pods/f016ba9e-f0b6-4232-988c-622e5941b750/volumes" Jun 11 23:06:26.261710 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:26.261594 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:27.262047 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:27.261972 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:28.262173 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:28.262116 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:29.261301 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:29.261253 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:30.261717 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:30.261655 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:31.261456 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:31.261408 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:32.262036 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:32.261945 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:33.261959 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:33.261911 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:34.261878 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:34.261824 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:34.262379 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:34.262243 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:35.261756 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:35.261704 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:36.261317 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:36.261219 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:37.262212 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:37.262158 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 23:06:38.372607 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:38.372564 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 23:06:38.386749 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:38.386710 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:06:48.378111 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:48.378062 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2f9f9ae3-af01-4378-87f1-7a5c66df9af9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:06:58.379459 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:06:58.379423 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:07:10.104219 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.104188 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:07:10.104592 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.104369 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-696747655d-cbhp2" podUID="4017eb28-53d5-426d-adee-cc9b518d1590" containerName="authorino" containerID="cri-o://be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35" gracePeriod=30 Jun 11 23:07:10.350243 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.350217 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:07:10.493739 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.493667 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5wf9\" (UniqueName: \"kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9\") pod \"4017eb28-53d5-426d-adee-cc9b518d1590\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " Jun 11 23:07:10.493739 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.493735 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert\") pod \"4017eb28-53d5-426d-adee-cc9b518d1590\" (UID: \"4017eb28-53d5-426d-adee-cc9b518d1590\") " Jun 11 23:07:10.495704 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.495677 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9" (OuterVolumeSpecName: "kube-api-access-f5wf9") pod "4017eb28-53d5-426d-adee-cc9b518d1590" (UID: "4017eb28-53d5-426d-adee-cc9b518d1590"). InnerVolumeSpecName "kube-api-access-f5wf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:07:10.502599 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.502574 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4017eb28-53d5-426d-adee-cc9b518d1590" (UID: "4017eb28-53d5-426d-adee-cc9b518d1590"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:07:10.595134 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.595111 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4017eb28-53d5-426d-adee-cc9b518d1590-tls-cert\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 23:07:10.595134 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:10.595131 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5wf9\" (UniqueName: \"kubernetes.io/projected/4017eb28-53d5-426d-adee-cc9b518d1590-kube-api-access-f5wf9\") on node \"ip-10-0-142-124.ec2.internal\" DevicePath \"\"" Jun 11 23:07:11.129876 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.129844 2574 generic.go:356] "Generic (PLEG): container finished" podID="4017eb28-53d5-426d-adee-cc9b518d1590" containerID="be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35" exitCode=0 Jun 11 23:07:11.130296 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.129884 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696747655d-cbhp2" Jun 11 23:07:11.130296 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.129914 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696747655d-cbhp2" event={"ID":"4017eb28-53d5-426d-adee-cc9b518d1590","Type":"ContainerDied","Data":"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35"} Jun 11 23:07:11.130296 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.129946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696747655d-cbhp2" event={"ID":"4017eb28-53d5-426d-adee-cc9b518d1590","Type":"ContainerDied","Data":"6e7f8cd0a6de406fc27057db87fb5427cfef0d632b22c6383a6bcdbeb48b60e6"} Jun 11 23:07:11.130296 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.129962 2574 scope.go:117] "RemoveContainer" containerID="be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35" Jun 11 23:07:11.138438 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.138419 2574 scope.go:117] "RemoveContainer" containerID="be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35" Jun 11 23:07:11.138698 ip-10-0-142-124 kubenswrapper[2574]: E0611 23:07:11.138678 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35\": container with ID starting with be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35 not found: ID does not exist" containerID="be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35" Jun 11 23:07:11.138738 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.138707 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35"} err="failed to get container status \"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35\": rpc error: code = NotFound desc = could not find container \"be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35\": container with ID starting with be6396f9d10f568a6ccf220e552c8491511a213b619f475edde3425ad7c9ba35 not found: ID does not exist" Jun 11 23:07:11.152549 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.152527 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:07:11.156875 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.156853 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-696747655d-cbhp2"] Jun 11 23:07:11.802881 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:11.802838 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4017eb28-53d5-426d-adee-cc9b518d1590" path="/var/lib/kubelet/pods/4017eb28-53d5-426d-adee-cc9b518d1590/volumes" Jun 11 23:07:15.851488 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.851459 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4"] Jun 11 23:07:15.851867 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.851751 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4017eb28-53d5-426d-adee-cc9b518d1590" containerName="authorino" Jun 11 23:07:15.851867 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.851762 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4017eb28-53d5-426d-adee-cc9b518d1590" containerName="authorino" Jun 11 23:07:15.851867 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.851812 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4017eb28-53d5-426d-adee-cc9b518d1590" containerName="authorino" Jun 11 23:07:15.856286 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.856268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.862909 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.862885 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:07:15.864471 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.864457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l74jk\"" Jun 11 23:07:15.864559 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.864470 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 23:07:15.864666 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.864651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:07:15.870750 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.870728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4"] Jun 11 23:07:15.939813 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.939784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.939952 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.939842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80c5061-3fb3-4b50-a580-896d232f6a87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.939952 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.939859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.940110 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.939942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcvrq\" (UniqueName: \"kubernetes.io/projected/e80c5061-3fb3-4b50-a580-896d232f6a87-kube-api-access-bcvrq\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.940110 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.940015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:15.940110 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:15.940099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.040959 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.040924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80c5061-3fb3-4b50-a580-896d232f6a87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.040959 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.040958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041238 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.040981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcvrq\" (UniqueName: \"kubernetes.io/projected/e80c5061-3fb3-4b50-a580-896d232f6a87-kube-api-access-bcvrq\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041238 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041238 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041238 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041485 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041401 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041485 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.041581 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.041527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.043335 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.043313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e80c5061-3fb3-4b50-a580-896d232f6a87-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.043498 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.043482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e80c5061-3fb3-4b50-a580-896d232f6a87-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.050492 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.050468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcvrq\" (UniqueName: \"kubernetes.io/projected/e80c5061-3fb3-4b50-a580-896d232f6a87-kube-api-access-bcvrq\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4\" (UID: \"e80c5061-3fb3-4b50-a580-896d232f6a87\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.184238 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.184147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:16.318463 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:16.318426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4"] Jun 11 23:07:16.321990 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:07:16.321959 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80c5061_3fb3_4b50_a580_896d232f6a87.slice/crio-c61afecd7aaf657d0dcbc525994ecb2b7ce15763fccb91f05b48fcd80544314f WatchSource:0}: Error finding container c61afecd7aaf657d0dcbc525994ecb2b7ce15763fccb91f05b48fcd80544314f: Status 404 returned error can't find the container with id c61afecd7aaf657d0dcbc525994ecb2b7ce15763fccb91f05b48fcd80544314f Jun 11 23:07:17.155968 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:17.155930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" event={"ID":"e80c5061-3fb3-4b50-a580-896d232f6a87","Type":"ContainerStarted","Data":"c61afecd7aaf657d0dcbc525994ecb2b7ce15763fccb91f05b48fcd80544314f"} Jun 11 23:07:20.180305 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:20.180269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" event={"ID":"e80c5061-3fb3-4b50-a580-896d232f6a87","Type":"ContainerStarted","Data":"854e64367161f9da672670ebed98df74dc7443772fc51db96d05fa06cd1ea780"} Jun 11 23:07:22.189370 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:22.189342 2574 generic.go:356] "Generic (PLEG): container finished" podID="e80c5061-3fb3-4b50-a580-896d232f6a87" containerID="854e64367161f9da672670ebed98df74dc7443772fc51db96d05fa06cd1ea780" exitCode=0 Jun 11 23:07:22.189721 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:22.189379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" event={"ID":"e80c5061-3fb3-4b50-a580-896d232f6a87","Type":"ContainerDied","Data":"854e64367161f9da672670ebed98df74dc7443772fc51db96d05fa06cd1ea780"} Jun 11 23:07:24.201632 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:24.201596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" event={"ID":"e80c5061-3fb3-4b50-a580-896d232f6a87","Type":"ContainerStarted","Data":"999d4e896d18640f461dd402bbc25485fc8a74b503bb48cd1a9a76996d4c4a9d"} Jun 11 23:07:24.223753 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:24.223706 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" podStartSLOduration=3.119739414 podStartE2EDuration="9.223692013s" totalImagesPullingTime="4.836896881s" totalInitContainerRuntime="1.267055718s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:24.220890885 +0000 UTC m=+888.861876462" watchObservedRunningTime="2026-06-11 23:07:24.223692013 +0000 UTC m=+888.864677589" Jun 11 23:07:26.184870 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:26.184836 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:26.185324 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:26.184904 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:26.197377 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:26.197357 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:26.223479 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:26.223455 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4" Jun 11 23:07:34.470067 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.470015 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j"] Jun 11 23:07:34.475908 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.475887 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.479135 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.479113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 23:07:34.485199 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.485173 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j"] Jun 11 23:07:34.497681 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.497773 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.497773 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlrl\" (UniqueName: \"kubernetes.io/projected/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kube-api-access-ljlrl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.497849 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.497894 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.497929 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.497908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598769 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlrl\" (UniqueName: \"kubernetes.io/projected/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kube-api-access-ljlrl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.598928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.598902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.599226 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.599203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.599279 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.599234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.599279 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.599265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.601197 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.601174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.601591 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.601569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.609827 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.609799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlrl\" (UniqueName: \"kubernetes.io/projected/9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f-kube-api-access-ljlrl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j\" (UID: \"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.786843 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.786754 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:34.954575 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:34.954546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j"] Jun 11 23:07:34.956917 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:07:34.956885 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8c9d04_75a7_416d_ba9b_0b2a4a72a08f.slice/crio-a95bbc05b7beebe01e590e1519fe4e113b761145bcb768400afb3f2d2e4bdced WatchSource:0}: Error finding container a95bbc05b7beebe01e590e1519fe4e113b761145bcb768400afb3f2d2e4bdced: Status 404 returned error can't find the container with id a95bbc05b7beebe01e590e1519fe4e113b761145bcb768400afb3f2d2e4bdced Jun 11 23:07:35.248380 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:35.248342 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" event={"ID":"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f","Type":"ContainerStarted","Data":"5f26f3a65591ee056b5da0954eda5ed63959f795539c516ad2255d31561c39f3"} Jun 11 23:07:35.248560 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:35.248401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" event={"ID":"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f","Type":"ContainerStarted","Data":"a95bbc05b7beebe01e590e1519fe4e113b761145bcb768400afb3f2d2e4bdced"} Jun 11 23:07:35.807695 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:35.807665 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:07:35.808170 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:35.807992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:07:37.258509 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:37.258476 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f" containerID="5f26f3a65591ee056b5da0954eda5ed63959f795539c516ad2255d31561c39f3" exitCode=0 Jun 11 23:07:37.258858 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:37.258548 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" event={"ID":"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f","Type":"ContainerDied","Data":"5f26f3a65591ee056b5da0954eda5ed63959f795539c516ad2255d31561c39f3"} Jun 11 23:07:38.264594 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:38.264560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" event={"ID":"9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f","Type":"ContainerStarted","Data":"7bf2316f2f0d2248dd94a47c42e18b0a86da38a6cf61dc58b9a8ab4d5bf0f9c9"} Jun 11 23:07:38.285524 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:38.285473 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" podStartSLOduration=2.753831969 podStartE2EDuration="4.285459285s" totalImagesPullingTime="224.246836ms" totalInitContainerRuntime="1.30738048s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:38.283915653 +0000 UTC m=+902.924901237" watchObservedRunningTime="2026-06-11 23:07:38.285459285 +0000 UTC m=+902.926444860" Jun 11 23:07:44.787149 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:44.787112 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:44.787536 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:44.787181 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:44.799689 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:44.799661 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:45.308524 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:45.308500 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j" Jun 11 23:07:48.962278 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:48.962247 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p"] Jun 11 23:07:48.964861 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:48.964841 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:48.968036 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:48.968002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 23:07:48.976887 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:48.976864 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p"] Jun 11 23:07:49.023034 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.023140 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.023140 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d242e17-ad60-4285-a3c0-be97ec5158fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.023215 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.023249 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6p4\" (UniqueName: \"kubernetes.io/projected/8d242e17-ad60-4285-a3c0-be97ec5158fc-kube-api-access-bj6p4\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.023282 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.023250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124145 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124145 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124322 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d242e17-ad60-4285-a3c0-be97ec5158fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124322 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124322 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6p4\" (UniqueName: \"kubernetes.io/projected/8d242e17-ad60-4285-a3c0-be97ec5158fc-kube-api-access-bj6p4\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124322 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124633 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124740 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.124740 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.124678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.126365 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.126338 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d242e17-ad60-4285-a3c0-be97ec5158fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.126760 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.126737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d242e17-ad60-4285-a3c0-be97ec5158fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.133470 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.133443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6p4\" (UniqueName: \"kubernetes.io/projected/8d242e17-ad60-4285-a3c0-be97ec5158fc-kube-api-access-bj6p4\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wd72p\" (UID: \"8d242e17-ad60-4285-a3c0-be97ec5158fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.275062 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.274924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:07:49.407501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:49.407479 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p"] Jun 11 23:07:49.409425 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:07:49.409399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d242e17_ad60_4285_a3c0_be97ec5158fc.slice/crio-24a6e57eafb35b557868117cb765a4ab8c9063e498a1a27ad39d01418bab2292 WatchSource:0}: Error finding container 24a6e57eafb35b557868117cb765a4ab8c9063e498a1a27ad39d01418bab2292: Status 404 returned error can't find the container with id 24a6e57eafb35b557868117cb765a4ab8c9063e498a1a27ad39d01418bab2292 Jun 11 23:07:50.320673 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:50.320631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" event={"ID":"8d242e17-ad60-4285-a3c0-be97ec5158fc","Type":"ContainerStarted","Data":"98d94d68119dfbb10b32b938844a18dd2656af3736a60bf0650a4e88017bcf12"} Jun 11 23:07:50.321117 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:50.320694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" event={"ID":"8d242e17-ad60-4285-a3c0-be97ec5158fc","Type":"ContainerStarted","Data":"24a6e57eafb35b557868117cb765a4ab8c9063e498a1a27ad39d01418bab2292"} Jun 11 23:07:56.178460 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.178426 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68"] Jun 11 23:07:56.181304 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.181282 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.184407 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.184384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 23:07:56.194318 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.194296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68"] Jun 11 23:07:56.290272 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ffad96-baf3-4760-8b0c-eef3abcf6229-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.290501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.290501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgrq\" (UniqueName: \"kubernetes.io/projected/54ffad96-baf3-4760-8b0c-eef3abcf6229-kube-api-access-8hgrq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.290501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.290501 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.290684 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.290512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391111 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391111 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgrq\" (UniqueName: \"kubernetes.io/projected/54ffad96-baf3-4760-8b0c-eef3abcf6229-kube-api-access-8hgrq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391312 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391388 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391439 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391488 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391448 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391538 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ffad96-baf3-4760-8b0c-eef3abcf6229-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391587 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.391643 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.391631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.393527 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.393499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ffad96-baf3-4760-8b0c-eef3abcf6229-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.393922 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.393901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ffad96-baf3-4760-8b0c-eef3abcf6229-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.399514 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.399494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgrq\" (UniqueName: \"kubernetes.io/projected/54ffad96-baf3-4760-8b0c-eef3abcf6229-kube-api-access-8hgrq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fcf68\" (UID: \"54ffad96-baf3-4760-8b0c-eef3abcf6229\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.491742 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.491647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" Jun 11 23:07:56.622306 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:56.622276 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68"] Jun 11 23:07:56.623765 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:07:56.623738 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ffad96_baf3_4760_8b0c_eef3abcf6229.slice/crio-35b1448f4f255a52e35777220ec2b57b4303cf7568c72375501ca4d5705b615e WatchSource:0}: Error finding container 35b1448f4f255a52e35777220ec2b57b4303cf7568c72375501ca4d5705b615e: Status 404 returned error can't find the container with id 35b1448f4f255a52e35777220ec2b57b4303cf7568c72375501ca4d5705b615e Jun 11 23:07:57.352365 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:57.352328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" event={"ID":"54ffad96-baf3-4760-8b0c-eef3abcf6229","Type":"ContainerStarted","Data":"03e38444566f94a9de6fc1227b38dc8b16411d0b2f04873dfdd8641b0675b19e"} Jun 11 23:07:57.352755 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:07:57.352377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fcf68" event={"ID":"54ffad96-baf3-4760-8b0c-eef3abcf6229","Type":"ContainerStarted","Data":"35b1448f4f255a52e35777220ec2b57b4303cf7568c72375501ca4d5705b615e"} Jun 11 23:08:01.371770 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:01.371732 2574 generic.go:356] "Generic (PLEG): container finished" podID="8d242e17-ad60-4285-a3c0-be97ec5158fc" containerID="98d94d68119dfbb10b32b938844a18dd2656af3736a60bf0650a4e88017bcf12" exitCode=0 Jun 11 23:08:01.372239 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:01.371807 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" event={"ID":"8d242e17-ad60-4285-a3c0-be97ec5158fc","Type":"ContainerDied","Data":"98d94d68119dfbb10b32b938844a18dd2656af3736a60bf0650a4e88017bcf12"} Jun 11 23:08:02.378556 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:02.378519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" event={"ID":"8d242e17-ad60-4285-a3c0-be97ec5158fc","Type":"ContainerStarted","Data":"2df175c6a7fca21546e37d5256b6c7dff0f5a524f2f8bbd4203e7bd9a91fee03"} Jun 11 23:08:02.399719 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:02.399668 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" podStartSLOduration=2.475468839 podStartE2EDuration="14.399653086s" totalImagesPullingTime="201.577383ms" totalInitContainerRuntime="11.722606864s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:02.397932019 +0000 UTC m=+927.038917638" watchObservedRunningTime="2026-06-11 23:08:02.399653086 +0000 UTC m=+927.040638662" Jun 11 23:08:09.275600 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:09.275564 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:08:09.276109 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:09.275624 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:08:09.288090 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:09.288071 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:08:09.425001 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:08:09.424976 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wd72p" Jun 11 23:12:35.834078 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:12:35.834051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:12:35.835805 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:12:35.835788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nrkc_7e098e39-7dbc-464d-8281-afd561b9f583/ovn-acl-logging/0.log" Jun 11 23:14:19.721877 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:19.721844 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fcf68_54ffad96-baf3-4760-8b0c-eef3abcf6229/storage-initializer/0.log" Jun 11 23:14:26.240354 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:26.240320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-8k7tp_32464d76-018f-44bf-b8b4-4c99ce41c6f7/copy-manifests/0.log" Jun 11 23:14:26.249551 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:26.249523 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-8k7tp_32464d76-018f-44bf-b8b4-4c99ce41c6f7/manager/0.log" Jun 11 23:14:27.994351 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:27.994325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mbh8r_4987f9ec-664a-44a3-813f-5cd810e641cf/kuadrant-console-plugin/0.log" Jun 11 23:14:28.230795 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:28.230763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kx87g_c778a567-b55a-465e-a012-5280c072c649/manager/0.log" Jun 11 23:14:29.198997 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:29.198965 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c495b869c-7fch9_5f2a96a9-bc85-40f5-9161-d8c05361a324/kube-auth-proxy/0.log" Jun 11 23:14:29.644626 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:29.644600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 23:14:29.975914 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:29.975827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4_e80c5061-3fb3-4b50-a580-896d232f6a87/storage-initializer/0.log" Jun 11 23:14:29.984262 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:29.984237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-d9hd4_e80c5061-3fb3-4b50-a580-896d232f6a87/main/0.log" Jun 11 23:14:30.211244 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:30.211218 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j_9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f/storage-initializer/0.log" Jun 11 23:14:30.222204 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:30.222174 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rgh6j_9d8c9d04-75a7-416d-ba9b-0b2a4a72a08f/main/0.log" Jun 11 23:14:30.460758 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:30.460723 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wd72p_8d242e17-ad60-4285-a3c0-be97ec5158fc/storage-initializer/0.log" Jun 11 23:14:30.469035 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:30.468992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wd72p_8d242e17-ad60-4285-a3c0-be97ec5158fc/main/0.log" Jun 11 23:14:30.579680 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:30.579656 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fcf68_54ffad96-baf3-4760-8b0c-eef3abcf6229/storage-initializer/0.log" Jun 11 23:14:37.681574 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:37.681543 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ntnjl_3f3f8b5c-6a22-4db8-b4d9-cedb63982c5a/global-pull-secret-syncer/0.log" Jun 11 23:14:37.808747 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:37.808717 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxwh5_d86772d4-1356-4d8b-b126-0b5070fa3a30/konnectivity-agent/0.log" Jun 11 23:14:37.909804 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:37.909775 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-124.ec2.internal_cf18cebe294061dc534d43c893c3b840/haproxy/0.log" Jun 11 23:14:42.886597 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:42.886567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mbh8r_4987f9ec-664a-44a3-813f-5cd810e641cf/kuadrant-console-plugin/0.log" Jun 11 23:14:42.963001 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:42.962950 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kx87g_c778a567-b55a-465e-a012-5280c072c649/manager/0.log" Jun 11 23:14:45.442522 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.442480 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/node-exporter/0.log" Jun 11 23:14:45.466038 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.465946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/kube-rbac-proxy/0.log" Jun 11 23:14:45.489344 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.489312 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sls9d_73413fc8-b712-4eb0-8d99-48a45b3a9551/init-textfile/0.log" Jun 11 23:14:45.640816 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.640781 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/prometheus/0.log" Jun 11 23:14:45.665897 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.665870 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/config-reloader/0.log" Jun 11 23:14:45.691726 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.691703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/thanos-sidecar/0.log" Jun 11 23:14:45.719474 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.719416 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/kube-rbac-proxy-web/0.log" Jun 11 23:14:45.743950 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.743932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/kube-rbac-proxy/0.log" Jun 11 23:14:45.766375 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.766357 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/kube-rbac-proxy-thanos/0.log" Jun 11 23:14:45.794064 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:45.794045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a1cca36-310d-4319-b699-70a2c5788aa0/init-config-reloader/0.log" Jun 11 23:14:47.433585 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:47.433545 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-mkt9h_9162cf6b-632a-481a-918b-6f42ecc96ef1/networking-console-plugin/0.log" Jun 11 23:14:48.767179 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.767147 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q"] Jun 11 23:14:48.769555 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.769540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:48.773061 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.773043 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b88td\"/\"default-dockercfg-bfjln\"" Jun 11 23:14:48.773177 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.773121 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b88td\"/\"openshift-service-ca.crt\"" Jun 11 23:14:48.774754 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.774728 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b88td\"/\"kube-root-ca.crt\"" Jun 11 23:14:48.779739 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.779721 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q"] Jun 11 23:14:48.921957 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.921928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-proc\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:48.922154 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.921977 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-lib-modules\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:48.922154 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.922062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtv2f\" (UniqueName: \"kubernetes.io/projected/ee9849e6-0381-41be-ab71-dd46c90f0a06-kube-api-access-qtv2f\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:48.922154 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.922094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-sys\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:48.922154 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:48.922122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-podres\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022767 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtv2f\" (UniqueName: \"kubernetes.io/projected/ee9849e6-0381-41be-ab71-dd46c90f0a06-kube-api-access-qtv2f\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022767 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-sys\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022933 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-podres\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022933 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-proc\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022933 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-lib-modules\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022933 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-sys\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.022933 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-proc\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.023166 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-lib-modules\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.023166 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.022966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee9849e6-0381-41be-ab71-dd46c90f0a06-podres\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.031971 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.031950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtv2f\" (UniqueName: \"kubernetes.io/projected/ee9849e6-0381-41be-ab71-dd46c90f0a06-kube-api-access-qtv2f\") pod \"perf-node-gather-daemonset-6wc2q\" (UID: \"ee9849e6-0381-41be-ab71-dd46c90f0a06\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.079852 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.079822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:49.208678 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:49.208649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q"] Jun 11 23:14:49.210049 ip-10-0-142-124 kubenswrapper[2574]: W0611 23:14:49.210003 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee9849e6_0381_41be_ab71_dd46c90f0a06.slice/crio-dd4fa2e9b4b22753a2e010551bcc76b77aa188a4cf11c396050f2df23d990734 WatchSource:0}: Error finding container dd4fa2e9b4b22753a2e010551bcc76b77aa188a4cf11c396050f2df23d990734: Status 404 returned error can't find the container with id dd4fa2e9b4b22753a2e010551bcc76b77aa188a4cf11c396050f2df23d990734 Jun 11 23:14:50.168054 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.168008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" event={"ID":"ee9849e6-0381-41be-ab71-dd46c90f0a06","Type":"ContainerStarted","Data":"45eefbde5fd05a44d7edd0463d23e6e62de164090579368b9a6bd93f2a1addda"} Jun 11 23:14:50.168460 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.168070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" event={"ID":"ee9849e6-0381-41be-ab71-dd46c90f0a06","Type":"ContainerStarted","Data":"dd4fa2e9b4b22753a2e010551bcc76b77aa188a4cf11c396050f2df23d990734"} Jun 11 23:14:50.168460 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.168138 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:50.190733 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.190690 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" podStartSLOduration=2.190677685 podStartE2EDuration="2.190677685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:14:50.188724158 +0000 UTC m=+1334.829709734" watchObservedRunningTime="2026-06-11 23:14:50.190677685 +0000 UTC m=+1334.831663260" Jun 11 23:14:50.715421 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.715384 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8k6t_ae410fb1-2876-44ab-8d38-c921292c6084/dns/0.log" Jun 11 23:14:50.759928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.759896 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8k6t_ae410fb1-2876-44ab-8d38-c921292c6084/kube-rbac-proxy/0.log" Jun 11 23:14:50.884648 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:50.884617 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hl8kw_d17bb9ff-7f34-4864-ad31-49a434929a5c/dns-node-resolver/0.log" Jun 11 23:14:51.463105 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:51.463008 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-867c974c55-58nrt_9b953fe2-f885-491a-97d1-9717822cf456/registry/0.log" Jun 11 23:14:51.469682 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:51.469657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-867c974c55-58nrt_9b953fe2-f885-491a-97d1-9717822cf456/registry/1.log" Jun 11 23:14:51.522947 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:51.522927 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jt8sv_9c00acbb-c757-4694-afca-3489ab3075ce/node-ca/0.log" Jun 11 23:14:52.762477 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:52.762443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c495b869c-7fch9_5f2a96a9-bc85-40f5-9161-d8c05361a324/kube-auth-proxy/0.log" Jun 11 23:14:52.964888 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:52.964858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 23:14:53.717970 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:53.717942 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9cvs_e3dd3ec7-a97d-4605-beea-94558f91aacc/serve-healthcheck-canary/0.log" Jun 11 23:14:54.312290 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:54.312258 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-27hx7_54669224-0235-452b-a132-b56cb7551c7a/insights-operator/0.log" Jun 11 23:14:54.315257 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:54.315234 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-27hx7_54669224-0235-452b-a132-b56cb7551c7a/insights-operator/1.log" Jun 11 23:14:54.514611 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:54.514576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nqn_815143d8-11e7-44c2-80a6-878ff15ea41e/kube-rbac-proxy/0.log" Jun 11 23:14:54.537425 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:54.537407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nqn_815143d8-11e7-44c2-80a6-878ff15ea41e/exporter/0.log" Jun 11 23:14:54.559658 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:54.559636 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nqn_815143d8-11e7-44c2-80a6-878ff15ea41e/extractor/0.log" Jun 11 23:14:56.182210 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:56.182182 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-6wc2q" Jun 11 23:14:57.246399 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:57.246366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-8k7tp_32464d76-018f-44bf-b8b4-4c99ce41c6f7/manager/0.log" Jun 11 23:14:57.268854 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:57.268832 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-8k7tp_32464d76-018f-44bf-b8b4-4c99ce41c6f7/copy-manifests/0.log" Jun 11 23:14:59.156216 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:14:59.156187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856696d794-x8qqv_da352b7a-b838-42bb-9b04-155fd35e2802/manager/0.log" Jun 11 23:15:02.983688 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:02.983654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c495b869c-7fch9_5f2a96a9-bc85-40f5-9161-d8c05361a324/kube-auth-proxy/0.log" Jun 11 23:15:03.048174 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:03.048147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 23:15:04.230924 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:04.230885 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c495b869c-7fch9_5f2a96a9-bc85-40f5-9161-d8c05361a324/kube-auth-proxy/0.log" Jun 11 23:15:04.315284 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:04.315252 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 23:15:06.088280 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.088251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/kube-multus-additional-cni-plugins/0.log" Jun 11 23:15:06.110928 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.110897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/egress-router-binary-copy/0.log" Jun 11 23:15:06.132253 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.132229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/cni-plugins/0.log" Jun 11 23:15:06.139166 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.139138 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c495b869c-7fch9_5f2a96a9-bc85-40f5-9161-d8c05361a324/kube-auth-proxy/0.log" Jun 11 23:15:06.154093 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.154069 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/bond-cni-plugin/0.log" Jun 11 23:15:06.176851 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.176829 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/routeoverride-cni/0.log" Jun 11 23:15:06.198034 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.197998 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/whereabouts-cni-bincopy/0.log" Jun 11 23:15:06.202268 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.202229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79648d7988-jxshk_9c82f1f3-56a3-4bee-8b0b-5a11f974ab41/router/0.log" Jun 11 23:15:06.226325 ip-10-0-142-124 kubenswrapper[2574]: I0611 23:15:06.226298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxh9_a82e2e68-9212-4aed-b15a-2806fa664a39/whereabouts-cni/0.log"