Jun 09 21:42:37.919550 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 21:42:37.919563 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 21:42:37.919572 ip-10-0-128-8 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 21:42:37.919796 ip-10-0-128-8 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 21:42:48.092027 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 21:42:48.092044 ip-10-0-128-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c41de860220a4b5dbd9fccaf0c304229 -- Jun 09 21:45:11.906966 ip-10-0-128-8 systemd[1]: Starting Kubernetes Kubelet... Jun 09 21:45:12.343587 ip-10-0-128-8 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:12.343587 ip-10-0-128-8 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 21:45:12.343587 ip-10-0-128-8 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:12.343587 ip-10-0-128-8 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 21:45:12.343587 ip-10-0-128-8 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:12.345668 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.345556 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351065 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351085 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351089 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351092 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351095 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351098 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.351094 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351101 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351106 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351109 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351111 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351114 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351116 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351119 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351121 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351124 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351127 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351129 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351132 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351134 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351137 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351139 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351142 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351144 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351147 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351151 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.351349 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351156 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351159 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351163 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351166 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351168 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351171 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351174 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351176 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351179 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351181 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351184 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351186 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351189 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351191 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351194 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351197 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351199 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351202 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351206 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351208 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.351860 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351212 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351214 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351217 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351219 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351221 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351224 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351226 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351230 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351234 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351237 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351239 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351241 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351245 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351248 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351250 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351252 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351255 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351257 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351260 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351262 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.352333 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351265 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351267 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351270 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351272 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351274 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351277 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351279 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351282 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351285 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351287 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351289 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351292 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351294 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351297 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351299 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351302 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351304 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351306 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351310 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351312 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.352818 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351314 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351317 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351319 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351322 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351324 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351326 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351328 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351331 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351333 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351335 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351337 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351340 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351343 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.351345 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352058 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352065 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352068 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352071 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352073 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352077 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.353314 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352080 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352082 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352085 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352087 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352089 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352093 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352095 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352097 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352100 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352102 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352105 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352107 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352110 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352113 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352115 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352117 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352120 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352123 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352125 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.353797 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352127 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352130 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352132 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352134 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352137 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352140 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352142 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352145 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352147 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352150 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352152 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352154 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352159 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352162 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352164 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352167 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352169 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352171 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352174 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352176 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.354280 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352179 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352183 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352186 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352189 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352192 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352196 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352199 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352202 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352205 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352208 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352211 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352214 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352216 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352218 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352221 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352223 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352226 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352229 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352232 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.354857 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352235 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352237 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352239 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352242 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352245 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352248 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352251 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352254 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352256 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352260 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352263 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352266 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352268 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352272 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352274 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352276 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352279 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352281 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352284 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352287 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.355317 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352289 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352292 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352294 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352297 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352299 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352301 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352304 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352306 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352308 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352311 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352314 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352316 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352319 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352321 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352323 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352712 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352717 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352722 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352725 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352728 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.355822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352730 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352733 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352736 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352739 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352741 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352743 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352746 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352748 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352751 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352753 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352755 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352758 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352761 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352763 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352766 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352768 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352771 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352773 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352776 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.356301 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352778 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352781 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352783 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352786 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352788 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352791 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352793 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352797 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352801 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352804 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352807 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352810 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352812 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352815 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352817 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352820 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352822 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352825 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352827 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352830 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.356775 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352833 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352835 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352837 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352840 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352842 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352845 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352847 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352850 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352853 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352855 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352857 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352859 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352862 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352864 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352867 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352870 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352872 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352874 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352877 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352879 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.357269 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352881 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352884 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352888 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352891 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352893 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352896 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352898 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352901 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352903 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352906 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352908 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352912 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352915 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352917 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352920 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352925 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352928 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352931 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352934 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.357782 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352936 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352939 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352941 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352944 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352946 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352948 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352950 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352955 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352958 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352960 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352963 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352965 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352967 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352970 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352972 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.352976 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353051 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353058 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353065 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353071 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353077 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 21:45:12.358227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353082 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353088 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353094 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353099 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353101 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353105 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353108 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353111 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353114 2579 flags.go:64] FLAG: --cgroup-root="" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353116 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353119 2579 flags.go:64] FLAG: --client-ca-file="" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353123 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353125 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353129 2579 flags.go:64] FLAG: --cluster-domain="" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353132 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353135 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353138 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353141 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353146 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353148 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353151 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353154 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353157 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353160 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 21:45:12.358740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353163 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353165 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353169 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353173 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353177 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353179 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353182 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353185 2579 flags.go:64] FLAG: --enable-server="true" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353188 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353193 2579 flags.go:64] FLAG: --event-burst="100" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353196 2579 flags.go:64] FLAG: --event-qps="50" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353198 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353201 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353203 2579 flags.go:64] FLAG: --eviction-hard="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353207 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353210 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353212 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353215 2579 flags.go:64] FLAG: --eviction-soft="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353218 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353220 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353224 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353226 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353229 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353232 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353234 2579 flags.go:64] FLAG: --feature-gates="" Jun 09 21:45:12.359296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353238 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353241 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353244 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353247 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353250 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353253 2579 flags.go:64] FLAG: --help="false" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353256 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353259 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353261 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353265 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353268 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353271 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353274 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353277 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353280 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353283 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353285 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353288 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353291 2579 flags.go:64] FLAG: --kube-reserved="" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353293 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353296 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353299 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353301 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353304 2579 flags.go:64] FLAG: --lock-file="" Jun 09 21:45:12.359926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353307 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353309 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353312 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353317 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353321 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353323 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353326 2579 flags.go:64] FLAG: --logging-format="text" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353329 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353332 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353336 2579 flags.go:64] FLAG: --manifest-url="" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353338 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353342 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353345 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353349 2579 flags.go:64] FLAG: --max-pods="110" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353351 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353354 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353356 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353362 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353365 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353367 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353370 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353377 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353380 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353383 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 21:45:12.360527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353385 2579 flags.go:64] FLAG: --pod-cidr="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353388 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353393 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353395 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353398 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353401 2579 flags.go:64] FLAG: --port="10250" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353403 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353406 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d97852df63811af5" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353408 2579 flags.go:64] FLAG: --qos-reserved="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353411 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353414 2579 flags.go:64] FLAG: --register-node="true" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353417 2579 flags.go:64] FLAG: --register-with-taints="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353421 2579 flags.go:64] FLAG: --registry-burst="10" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353424 2579 flags.go:64] FLAG: --registry-qps="5" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353426 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353429 2579 flags.go:64] FLAG: --reserved-memory="" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353433 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353437 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353439 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353442 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353444 2579 flags.go:64] FLAG: --runonce="false" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353447 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353450 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353453 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353455 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 21:45:12.361157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353458 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353462 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353465 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353467 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353470 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353473 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353475 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353478 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353481 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353483 2579 flags.go:64] FLAG: --system-cgroups="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353486 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353491 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353493 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353496 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353499 2579 flags.go:64] FLAG: --tls-min-version="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353502 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353504 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353507 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353509 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353512 2579 flags.go:64] FLAG: --v="2" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353516 2579 flags.go:64] FLAG: --version="false" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353521 2579 flags.go:64] FLAG: --vmodule="" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353524 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.353527 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353683 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.361769 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353688 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353691 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353694 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353697 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353700 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353703 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353706 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353709 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353713 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353716 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353718 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353721 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353724 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353726 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353729 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353731 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353734 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353736 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353739 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353741 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.362358 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353743 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353746 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353748 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353751 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353753 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353757 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353760 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353762 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353765 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353770 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353774 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353776 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353778 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353781 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353783 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353785 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353788 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353790 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353792 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.362858 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353797 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353799 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353802 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353804 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353807 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353810 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353812 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353814 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353817 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353819 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353823 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353826 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353829 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353832 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353834 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353837 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353839 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353842 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353844 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.363343 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353847 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353849 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353851 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353854 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353858 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353860 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353863 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353865 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353867 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353870 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353872 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353875 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353877 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353880 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353883 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353885 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353888 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353890 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353892 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353895 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.363822 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353897 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353900 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353902 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353905 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353907 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353910 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353913 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353916 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353919 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353922 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353925 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353927 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353930 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353933 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353935 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353938 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353945 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353948 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.364307 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.353950 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.354963 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.361986 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.362003 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.362964 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.362976 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363038 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363042 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363046 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363049 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363052 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363055 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363059 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363063 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.364844 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363066 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363069 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363072 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363075 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363078 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363081 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363084 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363086 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363089 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363093 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363096 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363099 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363101 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363104 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363107 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363109 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363112 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363115 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363117 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363120 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.365190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363122 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363127 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363130 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363133 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363136 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363139 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363142 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363144 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363147 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363149 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363152 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363157 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363159 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363162 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363164 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363166 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363169 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363171 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.365684 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363174 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363176 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363178 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363181 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363183 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363185 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363188 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363190 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363193 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363195 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363198 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363200 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363203 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363206 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363209 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363212 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363214 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363217 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363219 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363222 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.366133 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363224 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363227 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363229 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363232 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363235 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363237 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363240 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363242 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363245 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363247 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363250 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363252 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363255 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363257 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363260 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363263 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363265 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363268 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363270 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363273 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.366686 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363276 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363278 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363281 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363283 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363286 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363288 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363291 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363293 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363296 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363298 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363301 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363303 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.363308 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363427 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363431 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:12.367165 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363434 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363437 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363440 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363443 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363445 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363448 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363451 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363454 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363457 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363459 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363462 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363465 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363468 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363470 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363472 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363475 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363478 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363480 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363483 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363485 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:12.367526 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363487 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363490 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363493 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363495 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363498 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363500 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363503 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363506 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363508 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363510 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363513 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363515 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363517 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363520 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363522 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363524 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363527 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363529 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363531 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363534 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:12.368033 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363536 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363538 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363541 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363544 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363547 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363550 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363552 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363555 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363557 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363560 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363564 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363567 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363569 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363572 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363575 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363578 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363580 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363583 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363585 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:12.368504 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363589 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363592 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363594 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363597 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363599 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363601 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363605 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363608 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363611 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363613 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363616 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363618 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363620 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363622 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363625 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363627 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363629 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363632 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363634 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363636 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:12.369034 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363660 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363663 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363666 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363668 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363671 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363673 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363675 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363678 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363680 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363683 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363685 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363687 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363690 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363693 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363695 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363698 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363700 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:12.369507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:12.363703 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.363708 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.363820 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.366493 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.368039 2579 server.go:1019] "Starting client certificate rotation" Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.368134 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 21:45:12.369925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.368166 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 21:45:12.371386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.371372 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 21:45:12.377658 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.376959 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 21:45:12.382805 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.382787 2579 log.go:25] "Validated CRI v1 runtime API" Jun 09 21:45:12.385295 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.385281 2579 log.go:25] "Validated CRI v1 image API" Jun 09 21:45:12.386033 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.386014 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 21:45:12.388445 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.388425 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a85b1d1-bfe1-4eae-80ad-74729d0867f7:/dev/nvme0n1p3 e9cce7fe-3f80-4219-8102-5e98da9024bf:/dev/nvme0n1p4] Jun 09 21:45:12.388512 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.388444 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 21:45:12.393824 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.393575 2579 manager.go:216] Machine: {Timestamp:2026-06-09 21:45:12.392228845 +0000 UTC m=+0.359697675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202993 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238a6e9e477ced2ac89dcdf41275dc SystemUUID:ec238a6e-9e47-7ced-2ac8-9dcdf41275dc BootID:c41de860-220a-4b5d-bd9f-ccaf0c304229 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:6c:50:90:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:6c:50:90:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:15:41:ab:e5:e8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 21:45:12.393824 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.393818 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 21:45:12.393951 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.393894 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 21:45:12.397620 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.397599 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 21:45:12.397767 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.397625 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 21:45:12.398302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.398289 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 21:45:12.398302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.398302 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 21:45:12.398385 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.398311 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 21:45:12.398794 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.398783 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 21:45:12.399589 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.399578 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 21:45:12.402707 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.402689 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 21:45:12.403361 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403348 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 09 21:45:12.403485 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403475 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 21:45:12.403529 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403504 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 09 21:45:12.403529 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403522 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 21:45:12.403597 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403536 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 21:45:12.403597 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403545 2579 kubelet.go:398] "Adding apiserver pod source" Jun 09 21:45:12.403597 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403553 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 21:45:12.403990 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.403975 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 21:45:12.404040 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.404006 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 21:45:12.406559 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.406527 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 21:45:12.407972 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.407954 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 21:45:12.408056 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.407995 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 21:45:12.409157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409143 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409170 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409183 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409192 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409205 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409213 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 21:45:12.409227 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409226 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 21:45:12.409426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409234 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 21:45:12.409426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409252 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 21:45:12.409426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409262 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 21:45:12.409426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409276 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 21:45:12.409426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.409285 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 21:45:12.411048 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.411036 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 21:45:12.411099 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.411051 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 21:45:12.413976 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.413957 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 21:45:12.414754 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.414738 2579 server.go:1268] "Started kubelet" Jun 09 21:45:12.414835 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.414810 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 21:45:12.414885 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.414817 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 21:45:12.414885 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.414811 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 21:45:12.414992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.414941 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 21:45:12.415109 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.415059 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 21:45:12.418660 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.418573 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 21:45:12.419067 ip-10-0-128-8 systemd[1]: Started Kubernetes Kubelet. Jun 09 21:45:12.420778 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.420761 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 09 21:45:12.424846 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.424827 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 21:45:12.426020 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.424553 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-8.ec2.internal.18b787d1b5b41a57 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-8.ec2.internal,UID:ip-10-0-128-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-8.ec2.internal,},FirstTimestamp:2026-06-09 21:45:12.414714455 +0000 UTC m=+0.382183285,LastTimestamp:2026-06-09 21:45:12.414714455 +0000 UTC m=+0.382183285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-8.ec2.internal,}" Jun 09 21:45:12.426248 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.426235 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 21:45:12.426312 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.426269 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 21:45:12.426359 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.426311 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.426885 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.426866 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 21:45:12.426967 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.426866 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 21:45:12.426967 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.426906 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 21:45:12.427063 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427036 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 09 21:45:12.427063 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427046 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 09 21:45:12.427177 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427160 2579 factory.go:55] Registering systemd factory Jun 09 21:45:12.427222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427181 2579 factory.go:223] Registration of the systemd container factory successfully Jun 09 21:45:12.427406 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427391 2579 factory.go:153] Registering CRI-O factory Jun 09 21:45:12.427481 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427410 2579 factory.go:223] Registration of the crio container factory successfully Jun 09 21:45:12.427481 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427465 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 21:45:12.427573 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427490 2579 factory.go:103] Registering Raw factory Jun 09 21:45:12.427573 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427503 2579 manager.go:1196] Started watching for new ooms in manager Jun 09 21:45:12.428018 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.427991 2579 manager.go:349] Starting recovery of all containers Jun 09 21:45:12.438683 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.438630 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 21:45:12.438786 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.438758 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 21:45:12.443855 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.443841 2579 manager.go:354] Recovery completed Jun 09 21:45:12.444237 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.444205 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jw77r" Jun 09 21:45:12.448101 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.448087 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.449970 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.449954 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.450011 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.449989 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.450011 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.450003 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.450523 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.450493 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 21:45:12.450523 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.450519 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 21:45:12.450523 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.450501 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.450691 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.450534 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 09 21:45:12.451086 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.451075 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jw77r" Jun 09 21:45:12.451297 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.451283 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.451368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.451314 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.451368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.451327 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.452101 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.452021 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-8.ec2.internal.18b787d1b7ce1f66 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-8.ec2.internal,UID:ip-10-0-128-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-8.ec2.internal,},FirstTimestamp:2026-06-09 21:45:12.449974118 +0000 UTC m=+0.417442951,LastTimestamp:2026-06-09 21:45:12.449974118 +0000 UTC m=+0.417442951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-8.ec2.internal,}" Jun 09 21:45:12.452804 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.452791 2579 policy_none.go:49] "None policy: Start" Jun 09 21:45:12.452864 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.452811 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 21:45:12.452864 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.452823 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 21:45:12.454834 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.454821 2579 policy_none.go:47] "Start" Jun 09 21:45:12.486268 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486252 2579 manager.go:337] "Starting Device Plugin manager" Jun 09 21:45:12.486375 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.486360 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 21:45:12.486409 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486377 2579 server.go:87] "Starting device plugin registration server" Jun 09 21:45:12.486671 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486637 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 21:45:12.486755 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486672 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 21:45:12.486801 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486764 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 21:45:12.486883 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486848 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 21:45:12.486883 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.486868 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 21:45:12.487460 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.487391 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 21:45:12.487460 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.487444 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.506245 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.506221 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 21:45:12.517289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.507426 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 21:45:12.517289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.507475 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 21:45:12.517289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.507502 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 21:45:12.517289 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.507549 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 21:45:12.517289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.509565 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:12.587714 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.587678 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.589240 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.589218 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.589330 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.589254 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.589330 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.589296 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.589330 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.589328 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.598595 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.598547 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.598595 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.598573 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-8.ec2.internal\": node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.608571 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.608552 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"] Jun 09 21:45:12.608686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.608619 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.609968 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.609953 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.610033 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.609982 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.610033 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.609991 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.612184 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612172 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.612289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.612321 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612308 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.612894 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612877 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.612989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612882 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.612989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612931 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.612989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612942 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.612989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612910 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.612989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.612977 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.615212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.615195 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.615251 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.615237 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:12.617090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.617072 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:12.617163 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.617107 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:12.617163 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.617122 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:12.621915 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.621900 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.628205 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.628191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/175385351a4a50e51d389f09a322c4dd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"175385351a4a50e51d389f09a322c4dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.628260 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.628212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.628260 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.628230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.642214 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.642198 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-8.ec2.internal\" not found" node="ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.646502 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.646488 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-8.ec2.internal\" not found" node="ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.722843 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.722813 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.729191 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/175385351a4a50e51d389f09a322c4dd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"175385351a4a50e51d389f09a322c4dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.729291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.729291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.729291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/175385351a4a50e51d389f09a322c4dd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"175385351a4a50e51d389f09a322c4dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.729414 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.729414 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.729313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a25e8c30292c8b2ea571c377cb4ccd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"a25e8c30292c8b2ea571c377cb4ccd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.823343 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.823314 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.924131 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:12.924061 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:12.946527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.946493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:12.951456 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:12.951300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:13.025035 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:13.024993 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:13.125521 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:13.125489 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:13.226100 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:13.226019 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:13.326605 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:13.326572 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:13.367973 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.367947 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 21:45:13.368573 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.368131 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 21:45:13.426736 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:13.426711 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found" Jun 09 21:45:13.454793 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.454751 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 21:40:12 +0000 UTC" deadline="2028-02-18 22:23:04.048143422 +0000 UTC" Jun 09 21:45:13.454793 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.454781 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14856h37m50.593365767s" Jun 09 21:45:13.459182 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:13.459149 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25e8c30292c8b2ea571c377cb4ccd37.slice/crio-1a574ed01b9ea9cde6d64fe5a4af5e7f408954e222e9f48b8a00cabac548f485 WatchSource:0}: Error finding container 1a574ed01b9ea9cde6d64fe5a4af5e7f408954e222e9f48b8a00cabac548f485: Status 404 returned error can't find the container with id 1a574ed01b9ea9cde6d64fe5a4af5e7f408954e222e9f48b8a00cabac548f485 Jun 09 21:45:13.463992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.463974 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:45:13.466134 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:13.466113 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175385351a4a50e51d389f09a322c4dd.slice/crio-61ba0bfe6935a9dbfaa01f1dbcf6de283b6df9ba810b471d6fc240fc5985886d WatchSource:0}: Error finding container 61ba0bfe6935a9dbfaa01f1dbcf6de283b6df9ba810b471d6fc240fc5985886d: Status 404 returned error can't find the container with id 61ba0bfe6935a9dbfaa01f1dbcf6de283b6df9ba810b471d6fc240fc5985886d Jun 09 21:45:13.481852 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.481796 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:13.511027 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.510978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" event={"ID":"175385351a4a50e51d389f09a322c4dd","Type":"ContainerStarted","Data":"61ba0bfe6935a9dbfaa01f1dbcf6de283b6df9ba810b471d6fc240fc5985886d"} Jun 09 21:45:13.512037 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.512017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"a25e8c30292c8b2ea571c377cb4ccd37","Type":"ContainerStarted","Data":"1a574ed01b9ea9cde6d64fe5a4af5e7f408954e222e9f48b8a00cabac548f485"} Jun 09 21:45:13.527230 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.527208 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" Jun 09 21:45:13.539904 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.539882 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 21:45:13.541818 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.541806 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" Jun 09 21:45:13.547115 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.547099 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 21:45:13.644382 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.644354 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:13.725752 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:13.725722 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:14.405235 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.405202 2579 apiserver.go:52] "Watching apiserver" Jun 09 21:45:14.414014 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.413990 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 21:45:14.414834 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.414779 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-p9trq","kube-system/konnectivity-agent-nv7jx","openshift-cluster-node-tuning-operator/tuned-nttft","openshift-dns/node-resolver-8kfpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal","openshift-multus/multus-additional-cni-plugins-6fp2p","openshift-multus/multus-lcnzh","openshift-network-diagnostics/network-check-target-khxcp","kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7","openshift-image-registry/node-ca-9xv7h","openshift-multus/network-metrics-daemon-gh85r","openshift-network-operator/iptables-alerter-xh7j2","openshift-ovn-kubernetes/ovnkube-node-h5trw"] Jun 09 21:45:14.417363 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.417340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.419810 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.419787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.420384 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.420366 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.420532 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.420501 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5ffvk\"" Jun 09 21:45:14.420532 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.420367 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.420818 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.420803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 21:45:14.420885 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.420859 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 21:45:14.421836 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.421816 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 21:45:14.422111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.422095 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.422169 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.422130 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmm84\"" Jun 09 21:45:14.422348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.422330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.422348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.422342 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.424356 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.424114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.424962 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.424603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nmvv7\"" Jun 09 21:45:14.424962 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.424617 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.424962 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.424777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.424962 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.424800 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 21:45:14.425560 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.425538 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 21:45:14.425712 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.425538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 21:45:14.425712 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.425538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 21:45:14.426001 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.425985 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.426388 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.426373 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.426741 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.426724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-786ch\"" Jun 09 21:45:14.426894 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.426881 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 21:45:14.428730 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.428715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:14.428784 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.428771 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:14.431212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.431195 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.433844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.433446 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 21:45:14.433844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.433451 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 21:45:14.433844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.433526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwzx5\"" Jun 09 21:45:14.433844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.433663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.436216 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.436196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 21:45:14.436294 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.436226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 21:45:14.436410 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.436394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f2btc\"" Jun 09 21:45:14.436479 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.436462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.436792 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.436676 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 21:45:14.438502 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438344 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.438502 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.438669 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 21:45:14.438796 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtz8\" (UniqueName: \"kubernetes.io/projected/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-kube-api-access-5wtz8\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.438854 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-kubelet\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.438854 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-systemd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438853 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-script-lib\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438854 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9s5g5\"" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzbd\" (UniqueName: \"kubernetes.io/projected/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-kube-api-access-zwzbd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-multus\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.438949 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-var-lib-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438961 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-etc-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.438983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-node-log\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-system-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-socket-dir-parent\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-multus-certs\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-ovn\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-tmp-dir\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-bin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-log-socket\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-netd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-netns\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-daemon-config\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-etc-kubernetes\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-serviceca\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-systemd-units\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-os-release\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-cni-binary-copy\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-hostroot\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwppq\" (UniqueName: \"kubernetes.io/projected/c948b9e9-afc9-429f-8395-adb71dae3bb4-kube-api-access-dwppq\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9v2\" (UniqueName: \"kubernetes.io/projected/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-kube-api-access-bt9v2\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-slash\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-bin\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.439632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-k8s-cni-cncf-io\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-conf-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-host\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-netns\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-config\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovn-node-metrics-cert\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-hosts-file\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-cnibin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.439966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-kubelet\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.440336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.440003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-env-overrides\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.440899 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.440707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.441340 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.441233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.441430 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.441385 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:14.441636 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.441613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c2p9w\"" Jun 09 21:45:14.441636 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.441631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 21:45:14.441778 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.441634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.443783 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.443760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.443865 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.443832 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:14.448165 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.448144 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.450571 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.450551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:45:14.450571 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.450566 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 21:45:14.450932 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.450874 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z4rzd\"" Jun 09 21:45:14.456690 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.456671 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxjm5" Jun 09 21:45:14.463784 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.463766 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxjm5" Jun 09 21:45:14.527967 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.527942 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 21:45:14.540368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.540495 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-run\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.540495 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-system-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.540495 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-socket-dir-parent\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.540495 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-ovn\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-var-lib-kubelet\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540545 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-ovn\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540508 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-system-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-tmp\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-socket-dir-parent\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-log-socket\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-netd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-os-release\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-socket-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-log-socket\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-netd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-lib-modules\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-host\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-daemon-config\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.540978 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-serviceca\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.540995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28853467-f418-4419-9e4e-15d4189b874b-iptables-alerter-script\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-dbus\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-kubernetes\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-conf\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-systemd\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-os-release\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-cni-binary-copy\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-serviceca\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-hostroot\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-host\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541374 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-daemon-config\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.541392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-hostroot\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-os-release\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-host\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-cnibin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-cnibin\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/535da9eb-43f1-43da-8eb6-2db84264c3a0-konnectivity-ca\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-cnibin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-kubelet-config\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/535da9eb-43f1-43da-8eb6-2db84264c3a0-agent-certs\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-multus\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-var-lib-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-tuned\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-multus\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-multus-certs\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-tmp-dir\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-multus-certs\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-var-lib-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.542015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-bin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.541999 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c948b9e9-afc9-429f-8395-adb71dae3bb4-cni-binary-copy\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-sys-fs\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-netns\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-etc-kubernetes\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-cni-bin\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-systemd-units\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542125 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-tmp-dir\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvq5\" (UniqueName: \"kubernetes.io/projected/28853467-f418-4419-9e4e-15d4189b874b-kube-api-access-hkvq5\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-systemd-units\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-etc-kubernetes\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwppq\" (UniqueName: \"kubernetes.io/projected/c948b9e9-afc9-429f-8395-adb71dae3bb4-kube-api-access-dwppq\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-netns\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9v2\" (UniqueName: \"kubernetes.io/projected/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-kube-api-access-bt9v2\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.542693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-slash\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-slash\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-bin\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-config\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542457 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-cni-bin\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovn-node-metrics-cert\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-hosts-file\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-k8s-cni-cncf-io\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-conf-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-netns\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-device-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-modprobe-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysconfig\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-conf-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543265 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-sys\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542780 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-hosts-file\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-kubelet\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-run-k8s-cni-cncf-io\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-env-overrides\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtz8\" (UniqueName: \"kubernetes.io/projected/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-kube-api-access-5wtz8\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9njjr\" (UniqueName: \"kubernetes.io/projected/519ceeb3-e6c7-4478-b611-3a40dad364ec-kube-api-access-9njjr\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.542980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cf9\" (UniqueName: \"kubernetes.io/projected/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-kube-api-access-s8cf9\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g66w9\" (UniqueName: \"kubernetes.io/projected/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-kube-api-access-g66w9\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-kubelet\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-systemd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-config\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-script-lib\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543092 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzbd\" (UniqueName: \"kubernetes.io/projected/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-kube-api-access-zwzbd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.543873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28853467-f418-4419-9e4e-15d4189b874b-host-slash\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-etc-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-node-log\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qcwr\" (UniqueName: \"kubernetes.io/projected/f678a0aa-a46e-485e-9619-6ddb3daa165a-kube-api-access-6qcwr\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-registration-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543392 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-kubelet\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-host-run-netns\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543437 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-run-systemd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-etc-openvswitch\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-node-log\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-multus-cni-dir\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c948b9e9-afc9-429f-8395-adb71dae3bb4-host-var-lib-kubelet\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-env-overrides\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.544497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.543972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovnkube-script-lib\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.546334 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.546305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-ovn-node-metrics-cert\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.547138 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.547117 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:14.547138 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.547142 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:14.547284 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.547154 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:14.547284 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.547232 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:15.047210174 +0000 UTC m=+3.014679013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:14.550094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.549789 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwppq\" (UniqueName: \"kubernetes.io/projected/c948b9e9-afc9-429f-8395-adb71dae3bb4-kube-api-access-dwppq\") pod \"multus-lcnzh\" (UID: \"c948b9e9-afc9-429f-8395-adb71dae3bb4\") " pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.550094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.549924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9v2\" (UniqueName: \"kubernetes.io/projected/2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c-kube-api-access-bt9v2\") pod \"node-ca-9xv7h\" (UID: \"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c\") " pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.551958 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.551926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtz8\" (UniqueName: \"kubernetes.io/projected/8d7a06ef-dead-4d46-a19a-2ab0f4fe776a-kube-api-access-5wtz8\") pod \"node-resolver-8kfpb\" (UID: \"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a\") " pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.552075 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.552056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzbd\" (UniqueName: \"kubernetes.io/projected/e06adfab-9d53-4e01-b9e8-0b2220ad7de5-kube-api-access-zwzbd\") pod \"ovnkube-node-h5trw\" (UID: \"e06adfab-9d53-4e01-b9e8-0b2220ad7de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.643633 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-tuned\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.643808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.643808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-sys-fs\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.643808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.643808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvq5\" (UniqueName: \"kubernetes.io/projected/28853467-f418-4419-9e4e-15d4189b874b-kube-api-access-hkvq5\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.643946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643801 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-sys-fs\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.643946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.643946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-device-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.643946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.643946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-modprobe-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysconfig\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-sys\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.643997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-device-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9njjr\" (UniqueName: \"kubernetes.io/projected/519ceeb3-e6c7-4478-b611-3a40dad364ec-kube-api-access-9njjr\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644060 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cf9\" (UniqueName: \"kubernetes.io/projected/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-kube-api-access-s8cf9\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g66w9\" (UniqueName: \"kubernetes.io/projected/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-kube-api-access-g66w9\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28853467-f418-4419-9e4e-15d4189b874b-host-slash\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-modprobe-d\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qcwr\" (UniqueName: \"kubernetes.io/projected/f678a0aa-a46e-485e-9619-6ddb3daa165a-kube-api-access-6qcwr\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-registration-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-run\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-var-lib-kubelet\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-tmp\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-os-release\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-socket-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644380 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-system-cni-dir\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-lib-modules\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-host\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28853467-f418-4419-9e4e-15d4189b874b-iptables-alerter-script\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.644606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-os-release\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysconfig\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.644579 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644620 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-var-lib-kubelet\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-lib-modules\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.644691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:15.144625165 +0000 UTC m=+3.112093996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644721 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-host\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-registration-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-sys\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/519ceeb3-e6c7-4478-b611-3a40dad364ec-socket-dir\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-run\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.644840 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-dbus\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-kubernetes\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28853467-f418-4419-9e4e-15d4189b874b-host-slash\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-conf\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-systemd\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.645505 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-dbus\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.644969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:14.644988 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:15.144977065 +0000 UTC m=+3.112445884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-cnibin\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/535da9eb-43f1-43da-8eb6-2db84264c3a0-konnectivity-ca\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-kubelet-config\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f678a0aa-a46e-485e-9619-6ddb3daa165a-cnibin\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/535da9eb-43f1-43da-8eb6-2db84264c3a0-agent-certs\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-sysctl-conf\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-systemd\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-kubernetes\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28853467-f418-4419-9e4e-15d4189b874b-iptables-alerter-script\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/910e37f7-df05-4e18-8285-09adbbdd4f6d-kubelet-config\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645412 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f678a0aa-a46e-485e-9619-6ddb3daa165a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.645685 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/535da9eb-43f1-43da-8eb6-2db84264c3a0-konnectivity-ca\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.646337 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.646100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-etc-tuned\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.647153 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.647135 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-tmp\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.647276 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.647258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/535da9eb-43f1-43da-8eb6-2db84264c3a0-agent-certs\") pod \"konnectivity-agent-nv7jx\" (UID: \"535da9eb-43f1-43da-8eb6-2db84264c3a0\") " pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.651662 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.651620 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qcwr\" (UniqueName: \"kubernetes.io/projected/f678a0aa-a46e-485e-9619-6ddb3daa165a-kube-api-access-6qcwr\") pod \"multus-additional-cni-plugins-6fp2p\" (UID: \"f678a0aa-a46e-485e-9619-6ddb3daa165a\") " pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.652154 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.652123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvq5\" (UniqueName: \"kubernetes.io/projected/28853467-f418-4419-9e4e-15d4189b874b-kube-api-access-hkvq5\") pod \"iptables-alerter-xh7j2\" (UID: \"28853467-f418-4419-9e4e-15d4189b874b\") " pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.652242 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.652176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9njjr\" (UniqueName: \"kubernetes.io/projected/519ceeb3-e6c7-4478-b611-3a40dad364ec-kube-api-access-9njjr\") pod \"aws-ebs-csi-driver-node-s6gj7\" (UID: \"519ceeb3-e6c7-4478-b611-3a40dad364ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.654613 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.654596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cf9\" (UniqueName: \"kubernetes.io/projected/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-kube-api-access-s8cf9\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:14.657481 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.657435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g66w9\" (UniqueName: \"kubernetes.io/projected/efdbce9a-43dc-45b0-a37a-e5ab64252fe0-kube-api-access-g66w9\") pod \"tuned-nttft\" (UID: \"efdbce9a-43dc-45b0-a37a-e5ab64252fe0\") " pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:14.708595 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.708566 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:14.731762 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.731735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lcnzh" Jun 09 21:45:14.738998 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.738975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xv7h" Jun 09 21:45:14.747787 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.747768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:14.755319 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.755298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8kfpb" Jun 09 21:45:14.761847 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.761830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" Jun 09 21:45:14.768351 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.768333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:14.774890 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.774876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xh7j2" Jun 09 21:45:14.781420 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.781404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" Jun 09 21:45:14.785964 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:14.785947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nttft" Jun 09 21:45:15.048691 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.048590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:15.048814 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.048768 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:15.048814 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.048789 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:15.048814 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.048799 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:15.048969 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.048855 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:16.048839856 +0000 UTC m=+4.016308674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:15.150030 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.149983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:15.150194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.150037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:15.150194 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.150153 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:15.150194 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.150162 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:15.150314 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.150239 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:16.150224547 +0000 UTC m=+4.117693365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:15.150314 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:15.150257 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:16.150250828 +0000 UTC m=+4.117719646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:15.284181 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.284150 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3b8a04_a12a_47c4_a6a4_cf23e2e8af8c.slice/crio-0ec28f2ea30693832d6c818c3c78e77d5ee737b1f20716ddf064af7b9467632b WatchSource:0}: Error finding container 0ec28f2ea30693832d6c818c3c78e77d5ee737b1f20716ddf064af7b9467632b: Status 404 returned error can't find the container with id 0ec28f2ea30693832d6c818c3c78e77d5ee737b1f20716ddf064af7b9467632b Jun 09 21:45:15.285204 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.285184 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdbce9a_43dc_45b0_a37a_e5ab64252fe0.slice/crio-d04ef05c737f96139af569d0a4ff98ff1fe73a4a01e328ece71b3ab92bf8e614 WatchSource:0}: Error finding container d04ef05c737f96139af569d0a4ff98ff1fe73a4a01e328ece71b3ab92bf8e614: Status 404 returned error can't find the container with id d04ef05c737f96139af569d0a4ff98ff1fe73a4a01e328ece71b3ab92bf8e614 Jun 09 21:45:15.307809 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.307784 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28853467_f418_4419_9e4e_15d4189b874b.slice/crio-be12ad251970f37df5551de853f8557ed13143d240e40e65d0cde3327af2525f WatchSource:0}: Error finding container be12ad251970f37df5551de853f8557ed13143d240e40e65d0cde3327af2525f: Status 404 returned error can't find the container with id be12ad251970f37df5551de853f8557ed13143d240e40e65d0cde3327af2525f Jun 09 21:45:15.312813 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.312792 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519ceeb3_e6c7_4478_b611_3a40dad364ec.slice/crio-bb0c6dca384ce4b71157e3216739dccbb1a5260ef169e2321bbff05e12d8ad8e WatchSource:0}: Error finding container bb0c6dca384ce4b71157e3216739dccbb1a5260ef169e2321bbff05e12d8ad8e: Status 404 returned error can't find the container with id bb0c6dca384ce4b71157e3216739dccbb1a5260ef169e2321bbff05e12d8ad8e Jun 09 21:45:15.313805 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.313713 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7a06ef_dead_4d46_a19a_2ab0f4fe776a.slice/crio-877fdaecbe062e6984bac7764b15fad2b14e2ca2e61bc0b756b22bc96c38687b WatchSource:0}: Error finding container 877fdaecbe062e6984bac7764b15fad2b14e2ca2e61bc0b756b22bc96c38687b: Status 404 returned error can't find the container with id 877fdaecbe062e6984bac7764b15fad2b14e2ca2e61bc0b756b22bc96c38687b Jun 09 21:45:15.315706 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.314857 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf678a0aa_a46e_485e_9619_6ddb3daa165a.slice/crio-b5031940395eb7bc5818c12113acd62ef11c58241a2606d2f47231a6ad104acc WatchSource:0}: Error finding container b5031940395eb7bc5818c12113acd62ef11c58241a2606d2f47231a6ad104acc: Status 404 returned error can't find the container with id b5031940395eb7bc5818c12113acd62ef11c58241a2606d2f47231a6ad104acc Jun 09 21:45:15.315957 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:15.315729 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535da9eb_43f1_43da_8eb6_2db84264c3a0.slice/crio-de7f862fa1b2b921202e9baf0f11e2d2d186f4d20f2effc6b7f1d4d7cfac23d3 WatchSource:0}: Error finding container de7f862fa1b2b921202e9baf0f11e2d2d186f4d20f2effc6b7f1d4d7cfac23d3: Status 404 returned error can't find the container with id de7f862fa1b2b921202e9baf0f11e2d2d186f4d20f2effc6b7f1d4d7cfac23d3 Jun 09 21:45:15.467391 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.467357 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 21:40:14 +0000 UTC" deadline="2027-12-31 13:45:48.673211967 +0000 UTC" Jun 09 21:45:15.467391 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.467390 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13672h0m33.20582964s" Jun 09 21:45:15.516195 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.516159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xh7j2" event={"ID":"28853467-f418-4419-9e4e-15d4189b874b","Type":"ContainerStarted","Data":"be12ad251970f37df5551de853f8557ed13143d240e40e65d0cde3327af2525f"} Jun 09 21:45:15.517238 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.517210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nttft" event={"ID":"efdbce9a-43dc-45b0-a37a-e5ab64252fe0","Type":"ContainerStarted","Data":"d04ef05c737f96139af569d0a4ff98ff1fe73a4a01e328ece71b3ab92bf8e614"} Jun 09 21:45:15.518483 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.518457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xv7h" event={"ID":"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c","Type":"ContainerStarted","Data":"0ec28f2ea30693832d6c818c3c78e77d5ee737b1f20716ddf064af7b9467632b"} Jun 09 21:45:15.520422 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.520393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" event={"ID":"175385351a4a50e51d389f09a322c4dd","Type":"ContainerStarted","Data":"13b5e2cd4e1edc00980e45316d24030c0df1aa7223d3c2badd8d32105854843e"} Jun 09 21:45:15.521568 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.521545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerStarted","Data":"b5031940395eb7bc5818c12113acd62ef11c58241a2606d2f47231a6ad104acc"} Jun 09 21:45:15.522565 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.522544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8kfpb" event={"ID":"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a","Type":"ContainerStarted","Data":"877fdaecbe062e6984bac7764b15fad2b14e2ca2e61bc0b756b22bc96c38687b"} Jun 09 21:45:15.523751 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.523727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" event={"ID":"519ceeb3-e6c7-4478-b611-3a40dad364ec","Type":"ContainerStarted","Data":"bb0c6dca384ce4b71157e3216739dccbb1a5260ef169e2321bbff05e12d8ad8e"} Jun 09 21:45:15.524910 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.524888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lcnzh" event={"ID":"c948b9e9-afc9-429f-8395-adb71dae3bb4","Type":"ContainerStarted","Data":"35f929db83fd73cde8f94c7282209f019fa35fa463b8fa1f5de4dee0f3157dca"} Jun 09 21:45:15.526038 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.526015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nv7jx" event={"ID":"535da9eb-43f1-43da-8eb6-2db84264c3a0","Type":"ContainerStarted","Data":"de7f862fa1b2b921202e9baf0f11e2d2d186f4d20f2effc6b7f1d4d7cfac23d3"} Jun 09 21:45:15.527128 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.527112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"fff38372667a07c442acf65b3ed85634544a9a4c07d7e4f39cd71b12a3d2e6aa"} Jun 09 21:45:15.539335 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:15.539301 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" podStartSLOduration=2.539289368 podStartE2EDuration="2.539289368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:15.539054178 +0000 UTC m=+3.506523035" watchObservedRunningTime="2026-06-09 21:45:15.539289368 +0000 UTC m=+3.506758205" Jun 09 21:45:16.056759 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.056548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:16.056914 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.056795 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:16.056914 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.056818 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:16.056914 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.056830 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:16.056914 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.056901 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:18.056868801 +0000 UTC m=+6.024337622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:16.157681 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.157460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:16.157681 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.157509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:16.157681 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.157662 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:16.157956 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.157721 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:18.157702672 +0000 UTC m=+6.125171492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:16.157956 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.157782 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:16.157956 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.157812 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:18.157802282 +0000 UTC m=+6.125271103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:16.468091 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.467975 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 21:40:14 +0000 UTC" deadline="2027-12-24 05:32:02.348859089 +0000 UTC" Jun 09 21:45:16.468091 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.468041 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h46m45.880821124s" Jun 09 21:45:16.510417 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.510357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:16.510671 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.510481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:16.511129 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.511106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:16.511241 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.511220 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:16.511302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.511290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:16.511371 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:16.511353 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:16.543450 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.543349 2579 generic.go:356] "Generic (PLEG): container finished" podID="a25e8c30292c8b2ea571c377cb4ccd37" containerID="c34fb87252a805b758adecfbe79f6f89cd3243025d20bd4ac8ce75ad14999774" exitCode=0 Jun 09 21:45:16.543450 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:16.543425 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"a25e8c30292c8b2ea571c377cb4ccd37","Type":"ContainerDied","Data":"c34fb87252a805b758adecfbe79f6f89cd3243025d20bd4ac8ce75ad14999774"} Jun 09 21:45:17.561161 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:17.561122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"a25e8c30292c8b2ea571c377cb4ccd37","Type":"ContainerStarted","Data":"00b64c1df1a4b2aab941f46d76493f51ca85bfb1149044225afb4827cc0fe554"} Jun 09 21:45:17.576096 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:17.576020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" podStartSLOduration=4.576000153 podStartE2EDuration="4.576000153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:17.575170266 +0000 UTC m=+5.542639107" watchObservedRunningTime="2026-06-09 21:45:17.576000153 +0000 UTC m=+5.543468994" Jun 09 21:45:18.073213 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.072556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:18.073213 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.072797 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:18.073213 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.072817 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:18.073213 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.072828 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:18.073213 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.072881 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:22.07286403 +0000 UTC m=+10.040332852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:18.173195 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.173159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:18.173374 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.173209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:18.173374 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.173320 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:18.173477 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.173380 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:22.173360919 +0000 UTC m=+10.140829751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:18.173702 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.173664 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:18.173833 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.173730 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:22.173711741 +0000 UTC m=+10.141180560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.508750 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.508896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.508911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.509012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:18.508917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:18.509302 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:18.509179 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:20.508070 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:20.508105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:20.508070 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:20.508193 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:20.508292 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:20.508529 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:20.508362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:22.103449 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.103408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:22.103867 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.103623 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:22.103867 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.103657 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:22.103867 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.103670 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:22.103867 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.103726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:30.103708132 +0000 UTC m=+18.071176952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:22.203989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.203956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:22.204184 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.204049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:22.204184 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.204123 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:22.204184 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.204139 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:22.204320 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.204188 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:30.204174031 +0000 UTC m=+18.171642849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:22.204320 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.204205 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:30.204195887 +0000 UTC m=+18.171664708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:22.509693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.509611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:22.509843 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.509727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:22.509843 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:22.509771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:22.509843 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.509768 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:22.509987 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.509839 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:22.509987 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:22.509930 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:24.508500 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:24.508460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:24.508500 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:24.508485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:24.509038 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:24.508543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:24.509038 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:24.508677 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:24.509137 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:24.509095 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:24.509225 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:24.509191 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:26.508245 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:26.508207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:26.508686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:26.508207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:26.508686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:26.508337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:26.508686 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:26.508337 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:26.508686 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:26.508431 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:26.508686 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:26.508518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:28.507759 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:28.507725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:28.507759 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:28.507744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:28.508258 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:28.507725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:28.508258 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:28.507858 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:28.508258 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:28.507933 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:28.508258 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:28.508010 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:30.160393 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.160361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:30.160897 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.160519 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:30.160897 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.160534 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:30.160897 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.160542 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:30.160897 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.160590 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:46.160578046 +0000 UTC m=+34.128046864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:30.261759 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.261722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:30.261933 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.261773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:30.261933 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.261877 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:30.261933 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.261898 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:30.262088 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.261947 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:45:46.261931624 +0000 UTC m=+34.229400442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:30.262088 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.261965 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:45:46.261957258 +0000 UTC m=+34.229426076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:30.508307 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.508224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:30.508452 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.508344 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:30.508734 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.508697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:30.508862 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.508804 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:30.508919 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:30.508905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:30.509026 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:30.508984 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:32.508378 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:32.508349 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:32.508837 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:32.508493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:32.508837 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:32.508499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:32.508837 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:32.508519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:32.508837 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:32.508620 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:32.508837 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:32.508724 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:34.508345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.508068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:34.508952 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:34.508466 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:34.508952 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.508072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:34.508952 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:34.508574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:34.508952 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.508072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:34.508952 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:34.508635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:34.596099 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:45:34.596471 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596443 2579 generic.go:356] "Generic (PLEG): container finished" podID="e06adfab-9d53-4e01-b9e8-0b2220ad7de5" containerID="62c1203ec8f7de5250200eb4be9300de816d1f863485c4b980b75e30b5d59c55" exitCode=1 Jun 09 21:45:34.596584 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"f6d595027aef4231dfe7af88e235d04cf3381e7a288bee35b9ebcd04ed9180db"} Jun 09 21:45:34.596680 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"e03f0e78d7b696a855f2a3341d43dc7323d9e6a8dae0fcd133bc11b665609ef1"} Jun 09 21:45:34.596680 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"d982cc18ae40834ed09e6fac5e23116e48e98dbeae5d1b2c11e6de2c7d173b1b"} Jun 09 21:45:34.596761 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"eec4799ff0947f3200ea0bfd33ec98e608c530a51d61e27e6700922af52a40ba"} Jun 09 21:45:34.596761 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerDied","Data":"62c1203ec8f7de5250200eb4be9300de816d1f863485c4b980b75e30b5d59c55"} Jun 09 21:45:34.596826 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.596791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"306e408f4aa2e7c570e6d2c77c7b18eb072eedfef48fd8323809c59db286b0ef"} Jun 09 21:45:34.598041 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.598013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nttft" event={"ID":"efdbce9a-43dc-45b0-a37a-e5ab64252fe0","Type":"ContainerStarted","Data":"18b78ccb2796340edcb2a0dc7d476f4f04dc96430dbea6688d62e049c1c5b515"} Jun 09 21:45:34.601972 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.600623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xv7h" event={"ID":"2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c","Type":"ContainerStarted","Data":"8b35a06ef894b0eaaadcc721e49d26bb5eb7d2b055b38499b8999bf6ca08b1ad"} Jun 09 21:45:34.603661 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.603620 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="bb49e396e7e8cda1bccea93cb21176246df600739168e77bd9a15846658cab65" exitCode=0 Jun 09 21:45:34.603782 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.603673 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"bb49e396e7e8cda1bccea93cb21176246df600739168e77bd9a15846658cab65"} Jun 09 21:45:34.605203 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.605185 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8kfpb" event={"ID":"8d7a06ef-dead-4d46-a19a-2ab0f4fe776a","Type":"ContainerStarted","Data":"519ae4b6f43734fd910489229a1728a2f28d275883c7a7cd38a1637a7e803852"} Jun 09 21:45:34.606713 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.606678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" event={"ID":"519ceeb3-e6c7-4478-b611-3a40dad364ec","Type":"ContainerStarted","Data":"d146c50b21dcea8698c7e9bfaa4f203ece2f287eae04bfd1e3dc56eeba7a3f87"} Jun 09 21:45:34.608224 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.608198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lcnzh" event={"ID":"c948b9e9-afc9-429f-8395-adb71dae3bb4","Type":"ContainerStarted","Data":"985b3e17b90930939be939f64dd0a9e0e411e4a3a52a78d18b16c0f175a8702c"} Jun 09 21:45:34.609656 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.609606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nv7jx" event={"ID":"535da9eb-43f1-43da-8eb6-2db84264c3a0","Type":"ContainerStarted","Data":"9a21eab420c9533719f13af6f165ef79ba9cde3fc848ef77782d7bd1b6ac64c2"} Jun 09 21:45:34.614696 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.614637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nttft" podStartSLOduration=3.221734208 podStartE2EDuration="21.614621203s" totalImagesPullingTime="18.392886995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.613605066 +0000 UTC m=+22.581073907" watchObservedRunningTime="2026-06-09 21:45:34.614621203 +0000 UTC m=+22.582090042" Jun 09 21:45:34.626255 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.626216 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nv7jx" podStartSLOduration=4.282648786 podStartE2EDuration="22.626205084s" totalImagesPullingTime="18.343556298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.626160612 +0000 UTC m=+22.593629452" watchObservedRunningTime="2026-06-09 21:45:34.626205084 +0000 UTC m=+22.593673924" Jun 09 21:45:34.640610 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.640564 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xv7h" podStartSLOduration=8.829736568 podStartE2EDuration="22.640547211s" totalImagesPullingTime="13.810810643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.640126231 +0000 UTC m=+22.607595069" watchObservedRunningTime="2026-06-09 21:45:34.640547211 +0000 UTC m=+22.608016052" Jun 09 21:45:34.717690 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.717630 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8kfpb" podStartSLOduration=8.918276106 podStartE2EDuration="22.717615947s" totalImagesPullingTime="13.799339841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.691558711 +0000 UTC m=+22.659027551" watchObservedRunningTime="2026-06-09 21:45:34.717615947 +0000 UTC m=+22.685084806" Jun 09 21:45:34.733787 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.733751 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lcnzh" podStartSLOduration=4.350550314 podStartE2EDuration="22.733738535s" totalImagesPullingTime="18.383188221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.733232906 +0000 UTC m=+22.700701755" watchObservedRunningTime="2026-06-09 21:45:34.733738535 +0000 UTC m=+22.701207374" Jun 09 21:45:34.855986 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.855940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:34.856408 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.856393 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:34.981501 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:34.981362 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 21:45:35.498437 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.498289 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T21:45:34.981495372Z","UUID":"310804b7-a4a4-4f48-9074-daa8ad33c2a1","Handler":null,"Name":"","Endpoint":""} Jun 09 21:45:35.499863 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.499835 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 21:45:35.499982 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.499880 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 21:45:35.614402 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.614368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" event={"ID":"519ceeb3-e6c7-4478-b611-3a40dad364ec","Type":"ContainerStarted","Data":"29cc2ed9e428f8c0d1c8ec0a7244ef6ae8d15955c93907da1dd2c74ec9e07924"} Jun 09 21:45:35.615895 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.615869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xh7j2" event={"ID":"28853467-f418-4419-9e4e-15d4189b874b","Type":"ContainerStarted","Data":"15c308d589a10e9c81ba21f7ef564bfe279d8026860fb80f3005812ca1698ab6"} Jun 09 21:45:35.616904 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.616874 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:35.617373 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.617355 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nv7jx" Jun 09 21:45:35.630213 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:35.630172 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xh7j2" podStartSLOduration=5.277251175 podStartE2EDuration="23.630155412s" totalImagesPullingTime="18.352904237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:35.629960371 +0000 UTC m=+23.597429212" watchObservedRunningTime="2026-06-09 21:45:35.630155412 +0000 UTC m=+23.597624253" Jun 09 21:45:36.508845 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.508762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:36.509161 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:36.508894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:36.509262 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.509243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:36.509352 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:36.509332 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:36.509735 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.509710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:36.509859 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:36.509801 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:36.621277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.621248 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" event={"ID":"519ceeb3-e6c7-4478-b611-3a40dad364ec","Type":"ContainerStarted","Data":"f69c04b88718d29d681f3a27959a742fdd25f51f4654e8346acb491a0eb2ad1b"} Jun 09 21:45:36.624965 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.624947 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:45:36.637147 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:36.637097 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6gj7" podStartSLOduration=3.485167742 podStartE2EDuration="23.637081696s" totalImagesPullingTime="20.151913954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:36.636476256 +0000 UTC m=+24.603945098" watchObservedRunningTime="2026-06-09 21:45:36.637081696 +0000 UTC m=+24.604550536" Jun 09 21:45:37.632160 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:37.632136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:45:37.632713 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:37.632565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"1070a25357adf159610e90450c94386ea2281bcafbdf37d7cf096016300a28c6"} Jun 09 21:45:38.508307 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:38.508275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:38.508481 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:38.508281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:38.508481 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:38.508394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:38.508481 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:38.508426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:38.508622 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:38.508515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:38.508622 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:38.508599 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:39.639572 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.639407 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:45:39.640111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.639953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"e559e5e0ea536316ecd9bd00a1471bfab73c6f750a453b280da22a178bd30916"} Jun 09 21:45:39.640111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.640075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:39.640238 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.640134 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:39.640506 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.640473 2579 scope.go:117] "RemoveContainer" containerID="62c1203ec8f7de5250200eb4be9300de816d1f863485c4b980b75e30b5d59c55" Jun 09 21:45:39.641846 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.641819 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="b0ee32d8e3d5d71eb8fcfdd7362168fe2fa324be707ebf2ae23613bceab9b4cf" exitCode=0 Jun 09 21:45:39.641924 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.641868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"b0ee32d8e3d5d71eb8fcfdd7362168fe2fa324be707ebf2ae23613bceab9b4cf"} Jun 09 21:45:39.657157 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:39.657139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:40.508507 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.508479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:40.508735 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.508483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:40.508735 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.508581 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:40.508735 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.508483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:40.508735 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.508668 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:40.508735 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.508729 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:40.651031 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.651004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:45:40.651482 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.651444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" event={"ID":"e06adfab-9d53-4e01-b9e8-0b2220ad7de5","Type":"ContainerStarted","Data":"bfdee4963af62c685f61124dbe4206bdf7b8cf205beee7f12ced534b57da1b70"} Jun 09 21:45:40.651876 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.651792 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:40.667177 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.667150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:45:40.676368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.676323 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" podStartSLOduration=10.236774763 podStartE2EDuration="28.676310381s" totalImagesPullingTime="18.439535618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:40.674916399 +0000 UTC m=+28.642385249" watchObservedRunningTime="2026-06-09 21:45:40.676310381 +0000 UTC m=+28.643779220" Jun 09 21:45:40.793038 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.793009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-khxcp"] Jun 09 21:45:40.793188 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.793130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:40.793265 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.793231 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:40.796475 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.796452 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9trq"] Jun 09 21:45:40.796572 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.796560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:40.796728 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.796694 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:40.797296 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.797266 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh85r"] Jun 09 21:45:40.797379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:40.797364 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:40.797485 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:40.797462 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:41.655946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:41.655779 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="357e4eae340a9a75eb2ef7911291b9ee47fb2aa7f9198a10d47b9468eb0d44ce" exitCode=0 Jun 09 21:45:41.656282 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:41.655916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"357e4eae340a9a75eb2ef7911291b9ee47fb2aa7f9198a10d47b9468eb0d44ce"} Jun 09 21:45:42.508810 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:42.508783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:42.508981 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:42.508873 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:42.508981 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:42.508940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:42.509058 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:42.509041 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:42.509425 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:42.509403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:42.509749 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:42.509714 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:43.663185 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:43.663097 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="c4db92e48b08d133d4d7703caca03be308204dd5f178a532216113d0d53856f9" exitCode=0 Jun 09 21:45:43.663185 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:43.663147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"c4db92e48b08d133d4d7703caca03be308204dd5f178a532216113d0d53856f9"} Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:44.511198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:44.511226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:44.511297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:44.511308 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:44.511405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:44.511622 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:44.511477 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:46.184432 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.184392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:46.184882 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.184550 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:46.184882 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.184568 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:46.184882 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.184577 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2cwf7 for pod openshift-network-diagnostics/network-check-target-khxcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:46.184882 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.184624 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7 podName:6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3 nodeName:}" failed. No retries permitted until 2026-06-09 21:46:18.184610289 +0000 UTC m=+66.152079107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cwf7" (UniqueName: "kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7") pod "network-check-target-khxcp" (UID: "6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:46.285473 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.285441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:46.285664 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.285481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:46.285664 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.285603 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:46.285664 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.285603 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:46.285822 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.285681 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret podName:910e37f7-df05-4e18-8285-09adbbdd4f6d nodeName:}" failed. No retries permitted until 2026-06-09 21:46:18.285663388 +0000 UTC m=+66.253132221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret") pod "global-pull-secret-syncer-p9trq" (UID: "910e37f7-df05-4e18-8285-09adbbdd4f6d") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:46.285822 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.285733 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:46:18.285719385 +0000 UTC m=+66.253188211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:46.508485 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.508382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:46.508670 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.508389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:46.508670 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.508549 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-khxcp" podUID="6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3" Jun 09 21:45:46.508670 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.508603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9trq" podUID="910e37f7-df05-4e18-8285-09adbbdd4f6d" Jun 09 21:45:46.508670 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:46.508395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:46.508894 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:46.508720 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:45:47.805029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.804735 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeReady" Jun 09 21:45:47.805386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.805083 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 21:45:47.836697 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.836665 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:45:47.860693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.860632 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hsrx4"] Jun 09 21:45:47.861627 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.861604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.864179 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.864156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 21:45:47.864305 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.864230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 21:45:47.864305 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.864279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2zngw\"" Jun 09 21:45:47.864424 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.864403 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 21:45:47.868766 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.868745 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 21:45:47.874175 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.874158 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wxml9"] Jun 09 21:45:47.874277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.874264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:47.877897 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.876832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 21:45:47.877897 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.876991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qwpdx\"" Jun 09 21:45:47.877897 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.877485 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 21:45:47.893645 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.893628 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:45:47.893742 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.893677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsrx4"] Jun 09 21:45:47.893742 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.893697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxml9"] Jun 09 21:45:47.893742 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.893737 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:47.896222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.896203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 21:45:47.896311 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.896272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 21:45:47.896311 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.896272 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 21:45:47.896475 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.896425 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnqvv\"" Jun 09 21:45:47.995937 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.995909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996049 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.995962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b24534-d98f-4c43-8745-9eed725d9bef-tmp-dir\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:47.996049 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxmt\" (UniqueName: \"kubernetes.io/projected/0497a465-bc63-4882-9fd5-9270917d73e4-kube-api-access-6fxmt\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:47.996135 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996135 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2b24534-d98f-4c43-8745-9eed725d9bef-config-volume\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:47.996205 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996205 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996205 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0497a465-bc63-4882-9fd5-9270917d73e4-cert\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xh7p\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:47.996405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.996352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zmx\" (UniqueName: \"kubernetes.io/projected/c2b24534-d98f-4c43-8745-9eed725d9bef-kube-api-access-w2zmx\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:47.997129 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:47.997096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:48.081324 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.081245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:48.097106 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2b24534-d98f-4c43-8745-9eed725d9bef-config-volume\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.097222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097360 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.097246 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:45:48.097360 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.097259 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:45:48.097360 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.097314 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:45:48.597294796 +0000 UTC m=+36.564763619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:45:48.097587 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097635 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097635 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0497a465-bc63-4882-9fd5-9270917d73e4-cert\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:48.097745 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.097745 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xh7p\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097826 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097750 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2b24534-d98f-4c43-8745-9eed725d9bef-config-volume\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.097826 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097787 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097826 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zmx\" (UniqueName: \"kubernetes.io/projected/c2b24534-d98f-4c43-8745-9eed725d9bef-kube-api-access-w2zmx\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.097947 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.097947 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b24534-d98f-4c43-8745-9eed725d9bef-tmp-dir\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.098031 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.097943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxmt\" (UniqueName: \"kubernetes.io/projected/0497a465-bc63-4882-9fd5-9270917d73e4-kube-api-access-6fxmt\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:48.098031 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.098014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.098111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.098031 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.098111 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.098105 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:45:48.098191 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.098150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:45:48.598135249 +0000 UTC m=+36.565604070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:45:48.098358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.098332 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b24534-d98f-4c43-8745-9eed725d9bef-tmp-dir\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.099224 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.099201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.102137 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.102118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.102214 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.102147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.102465 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.102449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0497a465-bc63-4882-9fd5-9270917d73e4-cert\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:48.108140 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.108117 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zmx\" (UniqueName: \"kubernetes.io/projected/c2b24534-d98f-4c43-8745-9eed725d9bef-kube-api-access-w2zmx\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.109115 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.109087 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xh7p\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.110075 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.110057 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.110243 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.110225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxmt\" (UniqueName: \"kubernetes.io/projected/0497a465-bc63-4882-9fd5-9270917d73e4-kube-api-access-6fxmt\") pod \"ingress-canary-wxml9\" (UID: \"0497a465-bc63-4882-9fd5-9270917d73e4\") " pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:48.201539 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.201510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxml9" Jun 09 21:45:48.326074 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.326036 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxml9"] Jun 09 21:45:48.329040 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:45:48.329017 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0497a465_bc63_4882_9fd5_9270917d73e4.slice/crio-9ad739171b31fc7749d992e6bf76c11b79e8c4603337e42cebba910a5fae911c WatchSource:0}: Error finding container 9ad739171b31fc7749d992e6bf76c11b79e8c4603337e42cebba910a5fae911c: Status 404 returned error can't find the container with id 9ad739171b31fc7749d992e6bf76c11b79e8c4603337e42cebba910a5fae911c Jun 09 21:45:48.508445 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.508386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:45:48.508445 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.508400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:45:48.508687 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.508585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:45:48.510995 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.510939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 21:45:48.510995 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.510939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 21:45:48.511180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.510941 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5mcl\"" Jun 09 21:45:48.511180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.511014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 21:45:48.511180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.510941 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 21:45:48.511180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.510964 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2kzr\"" Jun 09 21:45:48.602419 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.602335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:48.602419 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.602406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:48.602594 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.602457 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:45:48.602594 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.602477 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:45:48.602594 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.602490 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:45:48.602594 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.602547 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:45:49.602516931 +0000 UTC m=+37.569985750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:45:48.602594 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:48.602563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:45:49.602556327 +0000 UTC m=+37.570025145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:45:48.679149 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.679112 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="b173a2332deb1f104c979f50c644f9ccbe3984a5fc4096d36d30ce5d62bf4b66" exitCode=0 Jun 09 21:45:48.679304 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.679170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"b173a2332deb1f104c979f50c644f9ccbe3984a5fc4096d36d30ce5d62bf4b66"} Jun 09 21:45:48.680400 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:48.680245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxml9" event={"ID":"0497a465-bc63-4882-9fd5-9270917d73e4","Type":"ContainerStarted","Data":"9ad739171b31fc7749d992e6bf76c11b79e8c4603337e42cebba910a5fae911c"} Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:49.611048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:49.611163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:49.611220 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:49.611236 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:49.611305 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:45:51.61127904 +0000 UTC m=+39.578747861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:49.611363 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:45:49.613909 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:49.611421 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:45:51.61140595 +0000 UTC m=+39.578874789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:45:49.687211 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:49.687169 2579 generic.go:356] "Generic (PLEG): container finished" podID="f678a0aa-a46e-485e-9619-6ddb3daa165a" containerID="4ff8d3eb9ad3e65b7cc8c9ee5b7841baf1243e76092c70e116b93df15eec37f8" exitCode=0 Jun 09 21:45:49.687369 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:49.687231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerDied","Data":"4ff8d3eb9ad3e65b7cc8c9ee5b7841baf1243e76092c70e116b93df15eec37f8"} Jun 09 21:45:50.690566 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.690528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxml9" event={"ID":"0497a465-bc63-4882-9fd5-9270917d73e4","Type":"ContainerStarted","Data":"5ac59773270e778cdcde2d07725f83d6461a3bc67acf7dc03fe466ce1d3edb8f"} Jun 09 21:45:50.694103 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.694072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" event={"ID":"f678a0aa-a46e-485e-9619-6ddb3daa165a","Type":"ContainerStarted","Data":"4f6116ba1731ee26c27969eb61680e1285504a370ce0fc9c047ccda9d7dc06f9"} Jun 09 21:45:50.707076 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.707025 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wxml9" podStartSLOduration=1.440462538 podStartE2EDuration="3.707009199s" totalImagesPullingTime="2.266546661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:50.705630574 +0000 UTC m=+38.673099413" watchObservedRunningTime="2026-06-09 21:45:50.707009199 +0000 UTC m=+38.674478039" Jun 09 21:45:50.725937 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.725660 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fp2p" podStartSLOduration=9.929616611 podStartE2EDuration="38.725621793s" totalImagesPullingTime="28.796005182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:50.723870313 +0000 UTC m=+38.691339154" watchObservedRunningTime="2026-06-09 21:45:50.725621793 +0000 UTC m=+38.693090636" Jun 09 21:45:50.843221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.843176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:50.887898 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:50.887808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:51.075740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:51.075707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:51.628558 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:51.628528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:51.628710 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:51.628568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:51.628710 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:51.628684 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:45:51.628710 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:51.628688 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:45:51.628710 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:51.628706 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:45:51.628839 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:51.628739 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:45:55.628723999 +0000 UTC m=+43.596192821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:45:51.628839 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:51.628753 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:45:55.628747352 +0000 UTC m=+43.596216170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:45:52.114451 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:52.114369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:52.218944 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:52.218911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:55.658135 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:55.658099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:45:55.658142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:55.658243 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:55.658252 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:55.658260 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:55.658309 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:46:03.658293466 +0000 UTC m=+51.625762284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:45:55.658503 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:45:55.658321 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:46:03.658315377 +0000 UTC m=+51.625784196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:46:03.718338 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:03.718301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:46:03.718338 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:03.718351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:46:03.718844 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:03.718466 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:46:03.718844 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:03.718483 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:46:03.718844 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:03.718491 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:03.718844 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:03.718554 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:46:19.718537119 +0000 UTC m=+67.686005938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:46:03.718844 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:03.718568 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:46:19.71856192 +0000 UTC m=+67.686030738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:46:12.668381 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:12.668356 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5trw" Jun 09 21:46:18.225072 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.225025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:46:18.227760 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.227740 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 21:46:18.237565 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.237541 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 21:46:18.250040 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.250015 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cwf7\" (UniqueName: \"kubernetes.io/projected/6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3-kube-api-access-2cwf7\") pod \"network-check-target-khxcp\" (UID: \"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3\") " pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:46:18.326222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.326186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:46:18.326383 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.326270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:46:18.329010 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.328991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 21:46:18.329104 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.329088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 21:46:18.336862 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:18.336843 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 21:46:18.336942 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:18.336908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:47:22.336887029 +0000 UTC m=+130.304355847 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : secret "metrics-daemon-secret" not found Jun 09 21:46:18.339064 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.339037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/910e37f7-df05-4e18-8285-09adbbdd4f6d-original-pull-secret\") pod \"global-pull-secret-syncer-p9trq\" (UID: \"910e37f7-df05-4e18-8285-09adbbdd4f6d\") " pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:46:18.518253 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.518170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9trq" Jun 09 21:46:18.529635 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.529608 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2kzr\"" Jun 09 21:46:18.537680 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.537654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:46:18.661787 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.661668 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9trq"] Jun 09 21:46:18.664560 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:46:18.664532 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910e37f7_df05_4e18_8285_09adbbdd4f6d.slice/crio-fb6c908cf5dc3ae5cfc1fdf743e3b7d598e2a6cb9a38f4f1e9f3476a20fee2cc WatchSource:0}: Error finding container fb6c908cf5dc3ae5cfc1fdf743e3b7d598e2a6cb9a38f4f1e9f3476a20fee2cc: Status 404 returned error can't find the container with id fb6c908cf5dc3ae5cfc1fdf743e3b7d598e2a6cb9a38f4f1e9f3476a20fee2cc Jun 09 21:46:18.682952 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.682930 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-khxcp"] Jun 09 21:46:18.686240 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:46:18.686217 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7e9fb1_3b91_40bc_98b7_f472d9d06eb3.slice/crio-f6589bfeb67786e08a8f89b475715bd17720b7ee0725d6820bf74c1e448d199e WatchSource:0}: Error finding container f6589bfeb67786e08a8f89b475715bd17720b7ee0725d6820bf74c1e448d199e: Status 404 returned error can't find the container with id f6589bfeb67786e08a8f89b475715bd17720b7ee0725d6820bf74c1e448d199e Jun 09 21:46:18.758801 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.758768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-khxcp" event={"ID":"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3","Type":"ContainerStarted","Data":"f6589bfeb67786e08a8f89b475715bd17720b7ee0725d6820bf74c1e448d199e"} Jun 09 21:46:18.759957 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:18.759932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p9trq" event={"ID":"910e37f7-df05-4e18-8285-09adbbdd4f6d","Type":"ContainerStarted","Data":"fb6c908cf5dc3ae5cfc1fdf743e3b7d598e2a6cb9a38f4f1e9f3476a20fee2cc"} Jun 09 21:46:19.736801 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:19.736763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:19.736845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:19.736953 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:19.736968 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:19.737025 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:46:51.737008402 +0000 UTC m=+99.704477221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:19.737095 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:19.737221 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:19.737124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:46:51.737114784 +0000 UTC m=+99.704583602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:46:23.774329 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:23.774289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-khxcp" event={"ID":"6d7e9fb1-3b91-40bc-98b7-f472d9d06eb3","Type":"ContainerStarted","Data":"7cc566ca9c7aca674a70abf350d87adcff9d48a573d0233cf9b4d655a80b34ff"} Jun 09 21:46:23.774809 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:23.774509 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:46:23.778993 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:23.778958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p9trq" event={"ID":"910e37f7-df05-4e18-8285-09adbbdd4f6d","Type":"ContainerStarted","Data":"bc82559cd4c62521fd579d6749dd4cd7db4b86f4619e6215824c8ac1e4b7be98"} Jun 09 21:46:23.789012 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:23.788961 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-khxcp" podStartSLOduration=67.617480704 podStartE2EDuration="1m11.788948174s" totalImagesPullingTime="4.17146747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:23.788264346 +0000 UTC m=+71.755733182" watchObservedRunningTime="2026-06-09 21:46:23.788948174 +0000 UTC m=+71.756417013" Jun 09 21:46:23.801388 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:23.801346 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p9trq" podStartSLOduration=66.604907737 podStartE2EDuration="1m10.801333206s" totalImagesPullingTime="4.196425469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:23.800274348 +0000 UTC m=+71.767743187" watchObservedRunningTime="2026-06-09 21:46:23.801333206 +0000 UTC m=+71.768802024" Jun 09 21:46:51.763206 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:51.763158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:46:51.763206 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:51.763210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:46:51.763674 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:51.763318 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:51.763674 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:51.763322 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:46:51.763674 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:51.763342 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:46:51.763674 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:51.763370 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:47:55.763357697 +0000 UTC m=+163.730826516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:46:51.763674 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:46:51.763398 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:47:55.763385338 +0000 UTC m=+163.730854157 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:46:54.784205 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:46:54.784178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-khxcp" Jun 09 21:47:22.372179 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:47:22.372136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:47:22.372631 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:22.372310 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 21:47:22.372631 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:22.372389 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs podName:c0b62fe1-e6b6-4520-ac7f-6e8dd510043b nodeName:}" failed. No retries permitted until 2026-06-09 21:49:24.372372225 +0000 UTC m=+252.339841043 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs") pod "network-metrics-daemon-gh85r" (UID: "c0b62fe1-e6b6-4520-ac7f-6e8dd510043b") : secret "metrics-daemon-secret" not found Jun 09 21:47:50.873135 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:50.873091 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" Jun 09 21:47:50.886331 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:50.886307 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hsrx4" podUID="c2b24534-d98f-4c43-8745-9eed725d9bef" Jun 09 21:47:50.984808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:47:50.984779 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:47:50.984970 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:47:50.984785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:47:51.522891 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:51.522852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gh85r" podUID="c0b62fe1-e6b6-4520-ac7f-6e8dd510043b" Jun 09 21:47:55.808496 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:47:55.808449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:47:55.808496 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:47:55.808499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:47:55.809080 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:55.808587 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:47:55.809080 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:55.808592 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 21:47:55.809080 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:55.808614 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb7fd8c7-wcwlp: secret "image-registry-tls" not found Jun 09 21:47:55.809080 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:55.808657 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls podName:c2b24534-d98f-4c43-8745-9eed725d9bef nodeName:}" failed. No retries permitted until 2026-06-09 21:49:57.808627153 +0000 UTC m=+285.776095971 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls") pod "dns-default-hsrx4" (UID: "c2b24534-d98f-4c43-8745-9eed725d9bef") : secret "dns-default-metrics-tls" not found Jun 09 21:47:55.809080 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:47:55.808680 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls podName:9e015646-baaa-40e4-9b93-9f0dac91a1ad nodeName:}" failed. No retries permitted until 2026-06-09 21:49:57.808666934 +0000 UTC m=+285.776135753 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls") pod "image-registry-77bb7fd8c7-wcwlp" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad") : secret "image-registry-tls" not found Jun 09 21:48:02.509594 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:02.509557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:48:51.752244 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.752199 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g"] Jun 09 21:48:51.757863 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.757839 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g"] Jun 09 21:48:51.757981 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.757943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" Jun 09 21:48:51.760092 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.760070 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g66sq\"" Jun 09 21:48:51.760215 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.760176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.760215 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.760175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.760418 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.760392 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-ch7hk"] Jun 09 21:48:51.760501 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.760489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.762500 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.762482 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 21:48:51.762802 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.762779 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rrwws\"" Jun 09 21:48:51.762802 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.762798 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 21:48:51.763027 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.763010 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.763119 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.763101 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.763263 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.763087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.763432 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.763033 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq"] Jun 09 21:48:51.766122 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.765346 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.766122 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.765566 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.766234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.766181 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ghp8j\"" Jun 09 21:48:51.766361 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.766345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 21:48:51.766536 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.766420 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 21:48:51.766846 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.766810 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b69874c99-h8zl2"] Jun 09 21:48:51.767006 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.766907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.769427 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.769410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g"] Jun 09 21:48:51.769516 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.769439 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g"] Jun 09 21:48:51.769516 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.769460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq"] Jun 09 21:48:51.769619 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.769526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.769699 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.769633 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b69874c99-h8zl2"] Jun 09 21:48:51.770329 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.770186 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.770329 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.770221 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.770329 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.770221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9hv4q\"" Jun 09 21:48:51.770513 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.770448 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 21:48:51.770919 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.770898 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 21:48:51.771611 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.771595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.771734 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.771629 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 21:48:51.772090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.771810 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 21:48:51.772090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.771944 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 21:48:51.772090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.772050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.772435 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.772329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 21:48:51.772435 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.772428 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hcbl2\"" Jun 09 21:48:51.772580 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.772449 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 21:48:51.781075 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.781056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ch7hk"] Jun 09 21:48:51.850633 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.850605 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nvfr7"] Jun 09 21:48:51.853540 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.853526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:51.855991 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.855973 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kmq2t\"" Jun 09 21:48:51.857474 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.857452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 21:48:51.857612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.857489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 21:48:51.857740 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.857725 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.857822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.857805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.861765 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.861749 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 21:48:51.865029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.865005 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nvfr7"] Jun 09 21:48:51.889175 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf1bda3-8126-41f0-a126-470f335894c5-serving-cert\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94fsx\" (UniqueName: \"kubernetes.io/projected/3cf1bda3-8126-41f0-a126-470f335894c5-kube-api-access-94fsx\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-service-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-trusted-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889434 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.889434 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.889434 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76hnc\" (UniqueName: \"kubernetes.io/projected/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-kube-api-access-76hnc\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.889434 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.889434 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-tmp\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889667 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-default-certificate\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.889667 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-snapshots\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.889667 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-stats-auth\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.889667 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.889667 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6v8\" (UniqueName: \"kubernetes.io/projected/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-kube-api-access-jq6v8\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.889830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d95c54fe-63e9-428a-9e33-c2d01d9f7831-config\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.889830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrdw\" (UniqueName: \"kubernetes.io/projected/4080b5c8-5fe4-4724-94ab-6b0a65e3fc46-kube-api-access-vsrdw\") pod \"volume-data-source-validator-78dd696465-hmw6g\" (UID: \"4080b5c8-5fe4-4724-94ab-6b0a65e3fc46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" Jun 09 21:48:51.889830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d95c54fe-63e9-428a-9e33-c2d01d9f7831-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.889830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.889784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967w5\" (UniqueName: \"kubernetes.io/projected/d95c54fe-63e9-428a-9e33-c2d01d9f7831-kube-api-access-967w5\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.990560 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-service-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.990560 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-trusted-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.990768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kzf\" (UniqueName: \"kubernetes.io/projected/f5f459db-f226-4192-ba63-9768de9fc9d3-kube-api-access-z2kzf\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:51.990768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5f459db-f226-4192-ba63-9768de9fc9d3-serving-cert\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:51.990768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-trusted-ca\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:51.990768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76hnc\" (UniqueName: \"kubernetes.io/projected/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-kube-api-access-76hnc\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:51.990841 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-tmp\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.990870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-config\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:51.990899 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:52.490873145 +0000 UTC m=+220.458341988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:51.990912 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 21:48:51.990938 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:51.990936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:48:52.490924846 +0000 UTC m=+220.458393666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:51.990956 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:52.490946659 +0000 UTC m=+220.458415478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : secret "router-metrics-certs-default" not found Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-default-certificate\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-snapshots\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-stats-auth\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6v8\" (UniqueName: \"kubernetes.io/projected/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-kube-api-access-jq6v8\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d95c54fe-63e9-428a-9e33-c2d01d9f7831-config\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-tmp\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrdw\" (UniqueName: \"kubernetes.io/projected/4080b5c8-5fe4-4724-94ab-6b0a65e3fc46-kube-api-access-vsrdw\") pod \"volume-data-source-validator-78dd696465-hmw6g\" (UID: \"4080b5c8-5fe4-4724-94ab-6b0a65e3fc46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d95c54fe-63e9-428a-9e33-c2d01d9f7831-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967w5\" (UniqueName: \"kubernetes.io/projected/d95c54fe-63e9-428a-9e33-c2d01d9f7831-kube-api-access-967w5\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-service-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf1bda3-8126-41f0-a126-470f335894c5-serving-cert\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.991358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94fsx\" (UniqueName: \"kubernetes.io/projected/3cf1bda3-8126-41f0-a126-470f335894c5-kube-api-access-94fsx\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.992291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cf1bda3-8126-41f0-a126-470f335894c5-trusted-ca-bundle\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.992291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.991618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cf1bda3-8126-41f0-a126-470f335894c5-snapshots\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.992291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.992008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d95c54fe-63e9-428a-9e33-c2d01d9f7831-config\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.992291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.992272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:51.993659 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.993624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-stats-auth\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:51.993741 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.993712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf1bda3-8126-41f0-a126-470f335894c5-serving-cert\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:51.993782 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.993767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d95c54fe-63e9-428a-9e33-c2d01d9f7831-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:51.993816 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:51.993788 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-default-certificate\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:52.002811 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.002759 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94fsx\" (UniqueName: \"kubernetes.io/projected/3cf1bda3-8126-41f0-a126-470f335894c5-kube-api-access-94fsx\") pod \"insights-operator-896549976-ch7hk\" (UID: \"3cf1bda3-8126-41f0-a126-470f335894c5\") " pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:52.003208 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.003189 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6v8\" (UniqueName: \"kubernetes.io/projected/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-kube-api-access-jq6v8\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:52.003327 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.003306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-967w5\" (UniqueName: \"kubernetes.io/projected/d95c54fe-63e9-428a-9e33-c2d01d9f7831-kube-api-access-967w5\") pod \"service-ca-operator-6bc5ff68f5-nn25g\" (UID: \"d95c54fe-63e9-428a-9e33-c2d01d9f7831\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:52.003626 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.003611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76hnc\" (UniqueName: \"kubernetes.io/projected/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-kube-api-access-76hnc\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:52.003911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.003891 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrdw\" (UniqueName: \"kubernetes.io/projected/4080b5c8-5fe4-4724-94ab-6b0a65e3fc46-kube-api-access-vsrdw\") pod \"volume-data-source-validator-78dd696465-hmw6g\" (UID: \"4080b5c8-5fe4-4724-94ab-6b0a65e3fc46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" Jun 09 21:48:52.069733 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.069701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" Jun 09 21:48:52.076719 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.076700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" Jun 09 21:48:52.083377 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.083356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ch7hk" Jun 09 21:48:52.093520 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.093090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kzf\" (UniqueName: \"kubernetes.io/projected/f5f459db-f226-4192-ba63-9768de9fc9d3-kube-api-access-z2kzf\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.093520 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.093143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5f459db-f226-4192-ba63-9768de9fc9d3-serving-cert\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.093520 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.093177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-trusted-ca\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.093520 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.093287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-config\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.094464 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.094396 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-trusted-ca\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.096946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.095424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5f459db-f226-4192-ba63-9768de9fc9d3-config\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.100173 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.100148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5f459db-f226-4192-ba63-9768de9fc9d3-serving-cert\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.103264 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.103246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kzf\" (UniqueName: \"kubernetes.io/projected/f5f459db-f226-4192-ba63-9768de9fc9d3-kube-api-access-z2kzf\") pod \"console-operator-668fdbf85c-nvfr7\" (UID: \"f5f459db-f226-4192-ba63-9768de9fc9d3\") " pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.162407 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.162359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:48:52.215518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.215475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g"] Jun 09 21:48:52.220098 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:48:52.220046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4080b5c8_5fe4_4724_94ab_6b0a65e3fc46.slice/crio-178509dcc9d49a9361ef01eb8e0967ffc7fd71cfadf2c0a7e1de6b0e9ed31f1d WatchSource:0}: Error finding container 178509dcc9d49a9361ef01eb8e0967ffc7fd71cfadf2c0a7e1de6b0e9ed31f1d: Status 404 returned error can't find the container with id 178509dcc9d49a9361ef01eb8e0967ffc7fd71cfadf2c0a7e1de6b0e9ed31f1d Jun 09 21:48:52.291162 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.291078 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nvfr7"] Jun 09 21:48:52.294549 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:48:52.294520 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f459db_f226_4192_ba63_9768de9fc9d3.slice/crio-0b5ef5454e7d2e482e7f821e8b0ebae88220df6608a8d6eed307f4a1f55c38f4 WatchSource:0}: Error finding container 0b5ef5454e7d2e482e7f821e8b0ebae88220df6608a8d6eed307f4a1f55c38f4: Status 404 returned error can't find the container with id 0b5ef5454e7d2e482e7f821e8b0ebae88220df6608a8d6eed307f4a1f55c38f4 Jun 09 21:48:52.437293 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.437273 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g"] Jun 09 21:48:52.439634 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:48:52.439609 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95c54fe_63e9_428a_9e33_c2d01d9f7831.slice/crio-066aa295c2b46be630b9024f12fcd5657d32e5f0db715b09d75ce77d824ae6b2 WatchSource:0}: Error finding container 066aa295c2b46be630b9024f12fcd5657d32e5f0db715b09d75ce77d824ae6b2: Status 404 returned error can't find the container with id 066aa295c2b46be630b9024f12fcd5657d32e5f0db715b09d75ce77d824ae6b2 Jun 09 21:48:52.439823 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.439807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ch7hk"] Jun 09 21:48:52.442564 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:48:52.442547 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf1bda3_8126_41f0_a126_470f335894c5.slice/crio-c4d9231c4f3d284ea56e6e1f91e5d812f03941a7da68ebe6d141c5d7c2605e97 WatchSource:0}: Error finding container c4d9231c4f3d284ea56e6e1f91e5d812f03941a7da68ebe6d141c5d7c2605e97: Status 404 returned error can't find the container with id c4d9231c4f3d284ea56e6e1f91e5d812f03941a7da68ebe6d141c5d7c2605e97 Jun 09 21:48:52.495891 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.495857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:52.496033 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.495900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:52.496033 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:52.495948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:52.496134 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:52.496069 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 21:48:52.496134 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:52.496077 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:52.496134 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:52.496110 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:53.496098409 +0000 UTC m=+221.463567227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : secret "router-metrics-certs-default" not found Jun 09 21:48:52.496255 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:52.496137 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:48:53.496120207 +0000 UTC m=+221.463589029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:52.496255 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:52.496186 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:53.496175289 +0000 UTC m=+221.463644108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:48:53.141745 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.141674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ch7hk" event={"ID":"3cf1bda3-8126-41f0-a126-470f335894c5","Type":"ContainerStarted","Data":"c4d9231c4f3d284ea56e6e1f91e5d812f03941a7da68ebe6d141c5d7c2605e97"} Jun 09 21:48:53.143542 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.143512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" event={"ID":"d95c54fe-63e9-428a-9e33-c2d01d9f7831","Type":"ContainerStarted","Data":"066aa295c2b46be630b9024f12fcd5657d32e5f0db715b09d75ce77d824ae6b2"} Jun 09 21:48:53.146413 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.146389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" event={"ID":"f5f459db-f226-4192-ba63-9768de9fc9d3","Type":"ContainerStarted","Data":"0b5ef5454e7d2e482e7f821e8b0ebae88220df6608a8d6eed307f4a1f55c38f4"} Jun 09 21:48:53.147774 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.147724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" event={"ID":"4080b5c8-5fe4-4724-94ab-6b0a65e3fc46","Type":"ContainerStarted","Data":"178509dcc9d49a9361ef01eb8e0967ffc7fd71cfadf2c0a7e1de6b0e9ed31f1d"} Jun 09 21:48:53.505474 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.505377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:53.505474 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.505440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:53.505474 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:53.505474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:53.505791 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:53.505537 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:53.505791 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:53.505605 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:48:55.505584174 +0000 UTC m=+223.473053003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:53.505791 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:53.505628 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 21:48:53.505791 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:53.505635 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:55.505614793 +0000 UTC m=+223.473083615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:48:53.505791 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:53.505685 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:55.505674146 +0000 UTC m=+223.473142971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : secret "router-metrics-certs-default" not found Jun 09 21:48:54.151507 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:54.151463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" event={"ID":"4080b5c8-5fe4-4724-94ab-6b0a65e3fc46","Type":"ContainerStarted","Data":"2a326b8c08240368b14f88349f3ba0ad84f0e901b144f9b7f31a783ec657681b"} Jun 09 21:48:54.167614 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:54.167563 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hmw6g" podStartSLOduration=1.7896737360000001 podStartE2EDuration="3.167548646s" totalImagesPullingTime="1.37787491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:48:54.165869558 +0000 UTC m=+222.133338400" watchObservedRunningTime="2026-06-09 21:48:54.167548646 +0000 UTC m=+222.135017464" Jun 09 21:48:55.526145 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:55.526108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:55.526164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:55.526182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:55.526280 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:55.526381 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:55.526293 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:59.526280782 +0000 UTC m=+227.493749600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:55.526430 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:48:59.526412745 +0000 UTC m=+227.493881571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:55.526526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:55.526445 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:48:59.526436799 +0000 UTC m=+227.493905617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : secret "router-metrics-certs-default" not found Jun 09 21:48:56.162236 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.162203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ch7hk" event={"ID":"3cf1bda3-8126-41f0-a126-470f335894c5","Type":"ContainerStarted","Data":"b0d3424768e6e357b1eee7baa9254b61d4294b0b9a927fc047c5fca4ae523d21"} Jun 09 21:48:56.163853 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.163822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" event={"ID":"d95c54fe-63e9-428a-9e33-c2d01d9f7831","Type":"ContainerStarted","Data":"737f69df719ae4c2f36ae3d531c5d455e787f97390d6dd886a16065b083a0270"} Jun 09 21:48:56.165405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.165382 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/0.log" Jun 09 21:48:56.165509 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.165424 2579 generic.go:356] "Generic (PLEG): container finished" podID="f5f459db-f226-4192-ba63-9768de9fc9d3" containerID="4ae28156ea63b2d2491634d8441797505fe2ebc2bbfde17395deb765f97fe8af" exitCode=255 Jun 09 21:48:56.165509 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.165457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" event={"ID":"f5f459db-f226-4192-ba63-9768de9fc9d3","Type":"ContainerDied","Data":"4ae28156ea63b2d2491634d8441797505fe2ebc2bbfde17395deb765f97fe8af"} Jun 09 21:48:56.165726 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.165711 2579 scope.go:117] "RemoveContainer" containerID="4ae28156ea63b2d2491634d8441797505fe2ebc2bbfde17395deb765f97fe8af" Jun 09 21:48:56.177129 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.177091 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-ch7hk" podStartSLOduration=2.186187999 podStartE2EDuration="5.177079838s" totalImagesPullingTime="2.990891839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:48:56.175860781 +0000 UTC m=+224.143329623" watchObservedRunningTime="2026-06-09 21:48:56.177079838 +0000 UTC m=+224.144548655" Jun 09 21:48:56.208058 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:56.207916 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" podStartSLOduration=2.218317545 podStartE2EDuration="5.207897667s" totalImagesPullingTime="2.989580122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:48:56.207622942 +0000 UTC m=+224.175091787" watchObservedRunningTime="2026-06-09 21:48:56.207897667 +0000 UTC m=+224.175366515" Jun 09 21:48:57.169452 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.169420 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:48:57.169930 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.169851 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/0.log" Jun 09 21:48:57.169930 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.169881 2579 generic.go:356] "Generic (PLEG): container finished" podID="f5f459db-f226-4192-ba63-9768de9fc9d3" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" exitCode=255 Jun 09 21:48:57.170029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.169966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" event={"ID":"f5f459db-f226-4192-ba63-9768de9fc9d3","Type":"ContainerDied","Data":"41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b"} Jun 09 21:48:57.170029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.170016 2579 scope.go:117] "RemoveContainer" containerID="4ae28156ea63b2d2491634d8441797505fe2ebc2bbfde17395deb765f97fe8af" Jun 09 21:48:57.170386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:57.170263 2579 scope.go:117] "RemoveContainer" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" Jun 09 21:48:57.170509 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:57.170428 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nvfr7_openshift-console-operator(f5f459db-f226-4192-ba63-9768de9fc9d3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" podUID="f5f459db-f226-4192-ba63-9768de9fc9d3" Jun 09 21:48:58.174013 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:58.173987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:48:58.174374 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:58.174336 2579 scope.go:117] "RemoveContainer" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" Jun 09 21:48:58.174512 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:58.174492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nvfr7_openshift-console-operator(f5f459db-f226-4192-ba63-9768de9fc9d3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" podUID="f5f459db-f226-4192-ba63-9768de9fc9d3" Jun 09 21:48:59.558719 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.558666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:48:59.558719 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.558727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.558748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:59.558835 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:59.558853 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:59.558900 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:49:07.558886578 +0000 UTC m=+235.526355396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : secret "router-metrics-certs-default" not found Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:59.558912 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:49:07.558906921 +0000 UTC m=+235.526375739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:48:59.559121 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:48:59.558924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:49:07.558918743 +0000 UTC m=+235.526387561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:48:59.765959 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.765921 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dbrpb"] Jun 09 21:48:59.770926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.770902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:48:59.773212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.773188 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 21:48:59.773344 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.773322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 21:48:59.773433 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.773291 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 21:48:59.774625 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.774606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vgdz5\"" Jun 09 21:48:59.774795 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.774737 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 21:48:59.776224 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.776199 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dbrpb"] Jun 09 21:48:59.879390 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.879372 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8kfpb_8d7a06ef-dead-4d46-a19a-2ab0f4fe776a/dns-node-resolver/0.log" Jun 09 21:48:59.962880 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.962846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-key\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:48:59.963015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.962889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29ffk\" (UniqueName: \"kubernetes.io/projected/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-kube-api-access-29ffk\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:48:59.963015 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:48:59.962931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-cabundle\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.064310 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.064276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-cabundle\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.064438 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.064412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-key\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.064488 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.064452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29ffk\" (UniqueName: \"kubernetes.io/projected/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-kube-api-access-29ffk\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.065049 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.065018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-cabundle\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.066958 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.066938 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-signing-key\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.071956 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.071931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29ffk\" (UniqueName: \"kubernetes.io/projected/d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e-kube-api-access-29ffk\") pod \"service-ca-7d74d578b8-dbrpb\" (UID: \"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e\") " pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.080663 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.080632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" Jun 09 21:49:00.197187 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.197153 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dbrpb"] Jun 09 21:49:00.200331 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:00.200298 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dc87a8_d927_4d86_8d06_3d4cb0ffe36e.slice/crio-9ca6a784e5a2d450e66861f31a5be8a1c9a349214dd62f69fafc0507fd47f12f WatchSource:0}: Error finding container 9ca6a784e5a2d450e66861f31a5be8a1c9a349214dd62f69fafc0507fd47f12f: Status 404 returned error can't find the container with id 9ca6a784e5a2d450e66861f31a5be8a1c9a349214dd62f69fafc0507fd47f12f Jun 09 21:49:00.881318 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:00.881292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xv7h_2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c/node-ca/0.log" Jun 09 21:49:01.183346 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:01.183267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" event={"ID":"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e","Type":"ContainerStarted","Data":"edb14d8320d1e0b4ae45c9ab22805ea7b1e233f8c543e8b325dffe41fcd11b30"} Jun 09 21:49:01.183346 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:01.183310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" event={"ID":"d8dc87a8-d927-4d86-8d06-3d4cb0ffe36e","Type":"ContainerStarted","Data":"9ca6a784e5a2d450e66861f31a5be8a1c9a349214dd62f69fafc0507fd47f12f"} Jun 09 21:49:01.201255 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:01.201199 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-dbrpb" podStartSLOduration=2.201184839 podStartE2EDuration="2.201184839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:01.200096445 +0000 UTC m=+229.167565287" watchObservedRunningTime="2026-06-09 21:49:01.201184839 +0000 UTC m=+229.168653677" Jun 09 21:49:01.881132 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:01.881067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxml9_0497a465-bc63-4882-9fd5-9270917d73e4/serve-healthcheck-canary/0.log" Jun 09 21:49:02.162905 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:02.162815 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:49:02.163413 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:02.163396 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:49:02.163902 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:02.163882 2579 scope.go:117] "RemoveContainer" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" Jun 09 21:49:02.164087 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:02.164065 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nvfr7_openshift-console-operator(f5f459db-f226-4192-ba63-9768de9fc9d3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" podUID="f5f459db-f226-4192-ba63-9768de9fc9d3" Jun 09 21:49:02.187367 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:02.187344 2579 scope.go:117] "RemoveContainer" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" Jun 09 21:49:02.187721 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:02.187684 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nvfr7_openshift-console-operator(f5f459db-f226-4192-ba63-9768de9fc9d3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" podUID="f5f459db-f226-4192-ba63-9768de9fc9d3" Jun 09 21:49:07.621193 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:07.621155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:49:07.621612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:07.621200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:07.621612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:07.621224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:07.621612 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:07.621320 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 21:49:07.621612 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:07.621341 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle podName:102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd nodeName:}" failed. No retries permitted until 2026-06-09 21:49:23.621324429 +0000 UTC m=+251.588793247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle") pod "router-default-7b69874c99-h8zl2" (UID: "102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd") : configmap references non-existent config key: service-ca.crt Jun 09 21:49:07.621612 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:07.621396 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls podName:92724e1f-bee6-4b01-a17f-ef6ad42dad4f nodeName:}" failed. No retries permitted until 2026-06-09 21:49:23.621380477 +0000 UTC m=+251.588849306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-d7slq" (UID: "92724e1f-bee6-4b01-a17f-ef6ad42dad4f") : secret "cluster-monitoring-operator-tls" not found Jun 09 21:49:07.623617 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:07.623600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-metrics-certs\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:14.512008 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:14.511980 2579 scope.go:117] "RemoveContainer" containerID="41ef3c3a9c33aa0ca68afe7cb67b1bacae45faf64fedd84dc056997aab1adf1b" Jun 09 21:49:15.228125 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:15.228100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:49:15.228283 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:15.228147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" event={"ID":"f5f459db-f226-4192-ba63-9768de9fc9d3","Type":"ContainerStarted","Data":"6efff83a8837303ee0f309e849612579ec28344dda9a1e20a663724f15490a73"} Jun 09 21:49:15.228431 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:15.228413 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:49:15.232686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:15.232664 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" Jun 09 21:49:15.244382 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:15.244347 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-nvfr7" podStartSLOduration=21.102879684 podStartE2EDuration="24.244333987s" totalImagesPullingTime="3.141454303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:15.242934844 +0000 UTC m=+243.210403684" watchObservedRunningTime="2026-06-09 21:49:15.244333987 +0000 UTC m=+243.211802826" Jun 09 21:49:20.074042 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.073971 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vdpwc"] Jun 09 21:49:20.076897 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.076879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.079572 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.079547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 21:49:20.080619 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.080595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 21:49:20.080746 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.080624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2btps\"" Jun 09 21:49:20.085979 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.085957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vdpwc"] Jun 09 21:49:20.114496 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.114471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d547ecf1-6d5e-4293-b911-a8c7bda13b41-data-volume\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.114612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.114498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.114612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.114520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d547ecf1-6d5e-4293-b911-a8c7bda13b41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.114612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.114599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d547ecf1-6d5e-4293-b911-a8c7bda13b41-crio-socket\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.114829 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.114622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjcv\" (UniqueName: \"kubernetes.io/projected/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-api-access-jvjcv\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d547ecf1-6d5e-4293-b911-a8c7bda13b41-data-volume\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215862 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d547ecf1-6d5e-4293-b911-a8c7bda13b41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215922 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215903 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d547ecf1-6d5e-4293-b911-a8c7bda13b41-data-volume\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215957 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d547ecf1-6d5e-4293-b911-a8c7bda13b41-crio-socket\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215996 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjcv\" (UniqueName: \"kubernetes.io/projected/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-api-access-jvjcv\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.215996 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.215966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d547ecf1-6d5e-4293-b911-a8c7bda13b41-crio-socket\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.216330 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.216310 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.218054 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.218030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d547ecf1-6d5e-4293-b911-a8c7bda13b41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.224387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.224360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjcv\" (UniqueName: \"kubernetes.io/projected/d547ecf1-6d5e-4293-b911-a8c7bda13b41-kube-api-access-jvjcv\") pod \"insights-runtime-extractor-vdpwc\" (UID: \"d547ecf1-6d5e-4293-b911-a8c7bda13b41\") " pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.386055 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.386023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vdpwc" Jun 09 21:49:20.505170 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:20.505140 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vdpwc"] Jun 09 21:49:20.508153 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:20.508122 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd547ecf1_6d5e_4293_b911_a8c7bda13b41.slice/crio-16d8e63c83e228dce8aefdaf2f6de0c3c429c70039bc26f6f7b6fc83ef775667 WatchSource:0}: Error finding container 16d8e63c83e228dce8aefdaf2f6de0c3c429c70039bc26f6f7b6fc83ef775667: Status 404 returned error can't find the container with id 16d8e63c83e228dce8aefdaf2f6de0c3c429c70039bc26f6f7b6fc83ef775667 Jun 09 21:49:21.250377 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:21.250347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdpwc" event={"ID":"d547ecf1-6d5e-4293-b911-a8c7bda13b41","Type":"ContainerStarted","Data":"65d1b5bfc02201bbf2f190268ca9d1abd40e58fe2ffc4ab2c293bfd28b21a090"} Jun 09 21:49:21.250748 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:21.250427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdpwc" event={"ID":"d547ecf1-6d5e-4293-b911-a8c7bda13b41","Type":"ContainerStarted","Data":"577b9484553d8a927da8698c14fd3fd62041e39295f43b83d5847b58469cf20a"} Jun 09 21:49:21.250748 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:21.250447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdpwc" event={"ID":"d547ecf1-6d5e-4293-b911-a8c7bda13b41","Type":"ContainerStarted","Data":"16d8e63c83e228dce8aefdaf2f6de0c3c429c70039bc26f6f7b6fc83ef775667"} Jun 09 21:49:23.258090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.258010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdpwc" event={"ID":"d547ecf1-6d5e-4293-b911-a8c7bda13b41","Type":"ContainerStarted","Data":"d4c557644ff6547c72813d7f6b8e7cf7cae83d21b939608a18ddd850df8acc22"} Jun 09 21:49:23.274899 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.274855 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vdpwc" podStartSLOduration=1.010634464 podStartE2EDuration="3.274839183s" totalImagesPullingTime="2.264204719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:49:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:23.274279586 +0000 UTC m=+251.241748426" watchObservedRunningTime="2026-06-09 21:49:23.274839183 +0000 UTC m=+251.242308023" Jun 09 21:49:23.644200 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.644159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:49:23.644384 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.644215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:23.644826 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.644803 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd-service-ca-bundle\") pod \"router-default-7b69874c99-h8zl2\" (UID: \"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd\") " pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:23.646558 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.646538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92724e1f-bee6-4b01-a17f-ef6ad42dad4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-d7slq\" (UID: \"92724e1f-bee6-4b01-a17f-ef6ad42dad4f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:49:23.890448 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.890414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9hv4q\"" Jun 09 21:49:23.895140 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.895078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hcbl2\"" Jun 09 21:49:23.898846 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.898831 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" Jun 09 21:49:23.903935 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:23.903917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:24.032793 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.032723 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq"] Jun 09 21:49:24.035557 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:24.035528 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92724e1f_bee6_4b01_a17f_ef6ad42dad4f.slice/crio-cb33f80b33fac8523ad8d36b653cdbde8ed7256d06e93d3ac419522c399bbc4f WatchSource:0}: Error finding container cb33f80b33fac8523ad8d36b653cdbde8ed7256d06e93d3ac419522c399bbc4f: Status 404 returned error can't find the container with id cb33f80b33fac8523ad8d36b653cdbde8ed7256d06e93d3ac419522c399bbc4f Jun 09 21:49:24.048969 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.048940 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b69874c99-h8zl2"] Jun 09 21:49:24.051739 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:24.051706 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102cd2c8_3616_4b1d_ab8a_af2bfd23fbdd.slice/crio-f27c2956b3e5e6deee98b8eee2e0a4b3ec79dd5fc3b1f1e7b5a02075470f42ab WatchSource:0}: Error finding container f27c2956b3e5e6deee98b8eee2e0a4b3ec79dd5fc3b1f1e7b5a02075470f42ab: Status 404 returned error can't find the container with id f27c2956b3e5e6deee98b8eee2e0a4b3ec79dd5fc3b1f1e7b5a02075470f42ab Jun 09 21:49:24.263682 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.263581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b69874c99-h8zl2" event={"ID":"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd","Type":"ContainerStarted","Data":"072f81f778e042f6d005d5c103402ae7a78930627f43f235c927aede26277c7d"} Jun 09 21:49:24.263682 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.263658 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b69874c99-h8zl2" event={"ID":"102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd","Type":"ContainerStarted","Data":"f27c2956b3e5e6deee98b8eee2e0a4b3ec79dd5fc3b1f1e7b5a02075470f42ab"} Jun 09 21:49:24.264778 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.264754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" event={"ID":"92724e1f-bee6-4b01-a17f-ef6ad42dad4f","Type":"ContainerStarted","Data":"cb33f80b33fac8523ad8d36b653cdbde8ed7256d06e93d3ac419522c399bbc4f"} Jun 09 21:49:24.280783 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.280738 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b69874c99-h8zl2" podStartSLOduration=33.280724519 podStartE2EDuration="33.280724519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:24.279748966 +0000 UTC m=+252.247217804" watchObservedRunningTime="2026-06-09 21:49:24.280724519 +0000 UTC m=+252.248193337" Jun 09 21:49:24.450489 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.450456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:49:24.452637 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.452621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0b62fe1-e6b6-4520-ac7f-6e8dd510043b-metrics-certs\") pod \"network-metrics-daemon-gh85r\" (UID: \"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b\") " pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:49:24.631399 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.631371 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:49:24.633814 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.633790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.636151 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 21:49:24.636246 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9qzsm\"" Jun 09 21:49:24.636246 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636151 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 21:49:24.636246 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636242 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 21:49:24.636400 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636154 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 21:49:24.636504 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.636483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 21:49:24.637167 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.637144 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 21:49:24.637231 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.637181 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 21:49:24.646041 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.646014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:49:24.712406 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.712376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5mcl\"" Jun 09 21:49:24.720456 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.720427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh85r" Jun 09 21:49:24.753415 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.753415 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.753625 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.753625 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.753730 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sczzv\" (UniqueName: \"kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.753730 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.753697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.842967 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.842934 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh85r"] Jun 09 21:49:24.845519 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:24.845485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b62fe1_e6b6_4520_ac7f_6e8dd510043b.slice/crio-2cde8121d8d7db4e06275cbe72adf695f5db7e03b790303c025f7cacd627d75a WatchSource:0}: Error finding container 2cde8121d8d7db4e06275cbe72adf695f5db7e03b790303c025f7cacd627d75a: Status 404 returned error can't find the container with id 2cde8121d8d7db4e06275cbe72adf695f5db7e03b790303c025f7cacd627d75a Jun 09 21:49:24.854074 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854154 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854154 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854261 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854261 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sczzv\" (UniqueName: \"kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854521 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.854876 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.854858 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.855017 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.855001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.855060 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.855013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.857255 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.857236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.857728 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.857711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.861433 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.861411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sczzv\" (UniqueName: \"kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv\") pod \"console-86899b98df-h54zh\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:24.904307 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.904237 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:24.907053 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.907036 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:24.944102 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:24.944060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:25.073817 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:25.073734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:49:25.076682 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:25.076637 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577db27d_d803_4a8c_a0f6_07e78fc5a767.slice/crio-9a56d5a2aafe71e63d3c8b84d90a4f7a96e1307c69ce623937d9be88d7fbc046 WatchSource:0}: Error finding container 9a56d5a2aafe71e63d3c8b84d90a4f7a96e1307c69ce623937d9be88d7fbc046: Status 404 returned error can't find the container with id 9a56d5a2aafe71e63d3c8b84d90a4f7a96e1307c69ce623937d9be88d7fbc046 Jun 09 21:49:25.269259 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:25.269186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86899b98df-h54zh" event={"ID":"577db27d-d803-4a8c-a0f6-07e78fc5a767","Type":"ContainerStarted","Data":"9a56d5a2aafe71e63d3c8b84d90a4f7a96e1307c69ce623937d9be88d7fbc046"} Jun 09 21:49:25.270292 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:25.270268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh85r" event={"ID":"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b","Type":"ContainerStarted","Data":"2cde8121d8d7db4e06275cbe72adf695f5db7e03b790303c025f7cacd627d75a"} Jun 09 21:49:25.270444 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:25.270426 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:25.271567 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:25.271548 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b69874c99-h8zl2" Jun 09 21:49:26.276428 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.276384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh85r" event={"ID":"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b","Type":"ContainerStarted","Data":"a11fa49d4e6b55a57f03bde72a18dae454baf6725f02cae4e0601a6ce572a9e0"} Jun 09 21:49:26.276870 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.276493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh85r" event={"ID":"c0b62fe1-e6b6-4520-ac7f-6e8dd510043b","Type":"ContainerStarted","Data":"862c6a48ccaf395484a48feee15db8f94745b3fa08806b961ffc9d78d40aa605"} Jun 09 21:49:26.293763 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.293707 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gh85r" podStartSLOduration=252.330913739 podStartE2EDuration="4m13.293688809s" totalImagesPullingTime="962.77507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:26.291573231 +0000 UTC m=+254.259042073" watchObservedRunningTime="2026-06-09 21:49:26.293688809 +0000 UTC m=+254.261157650" Jun 09 21:49:26.965059 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.965018 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t"] Jun 09 21:49:26.968457 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.968438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:26.970791 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.970770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 21:49:26.970791 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.970792 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n7vl5\"" Jun 09 21:49:26.976124 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:26.976058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t"] Jun 09 21:49:27.072105 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.072062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rmc4t\" (UID: \"7f11ce06-9742-40d3-a2d6-2f54f51a38ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:27.173361 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.173320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rmc4t\" (UID: \"7f11ce06-9742-40d3-a2d6-2f54f51a38ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:27.173531 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:27.173508 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 21:49:27.173605 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:27.173594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates podName:7f11ce06-9742-40d3-a2d6-2f54f51a38ba nodeName:}" failed. No retries permitted until 2026-06-09 21:49:27.67357208 +0000 UTC m=+255.641040903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-rmc4t" (UID: "7f11ce06-9742-40d3-a2d6-2f54f51a38ba") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 21:49:27.282034 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.281941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" event={"ID":"92724e1f-bee6-4b01-a17f-ef6ad42dad4f","Type":"ContainerStarted","Data":"ad6fb1e0fdfc0aa79d799b2fd7c1e17b650c0767d6d8dc4dffee4427034e4642"} Jun 09 21:49:27.299531 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.299473 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-d7slq" podStartSLOduration=33.847211064 podStartE2EDuration="36.299454507s" totalImagesPullingTime="2.452243443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:27.299301836 +0000 UTC m=+255.266770677" watchObservedRunningTime="2026-06-09 21:49:27.299454507 +0000 UTC m=+255.266923348" Jun 09 21:49:27.678930 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.678901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rmc4t\" (UID: \"7f11ce06-9742-40d3-a2d6-2f54f51a38ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:27.681273 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.681246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f11ce06-9742-40d3-a2d6-2f54f51a38ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rmc4t\" (UID: \"7f11ce06-9742-40d3-a2d6-2f54f51a38ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:27.878512 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:27.878484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:28.020007 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:28.019980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t"] Jun 09 21:49:29.021876 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:29.021831 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f11ce06_9742_40d3_a2d6_2f54f51a38ba.slice/crio-e0e93481908bbf702843ac581f1b3cf8cc81bd0d3904f04484a5eaf04449f79c WatchSource:0}: Error finding container e0e93481908bbf702843ac581f1b3cf8cc81bd0d3904f04484a5eaf04449f79c: Status 404 returned error can't find the container with id e0e93481908bbf702843ac581f1b3cf8cc81bd0d3904f04484a5eaf04449f79c Jun 09 21:49:29.289616 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:29.289526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" event={"ID":"7f11ce06-9742-40d3-a2d6-2f54f51a38ba","Type":"ContainerStarted","Data":"e0e93481908bbf702843ac581f1b3cf8cc81bd0d3904f04484a5eaf04449f79c"} Jun 09 21:49:29.290967 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:29.290941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86899b98df-h54zh" event={"ID":"577db27d-d803-4a8c-a0f6-07e78fc5a767","Type":"ContainerStarted","Data":"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2"} Jun 09 21:49:29.306724 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:29.306680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86899b98df-h54zh" podStartSLOduration=1.316670708 podStartE2EDuration="5.306664414s" totalImagesPullingTime="3.989993706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:29.3053978 +0000 UTC m=+257.272866643" watchObservedRunningTime="2026-06-09 21:49:29.306664414 +0000 UTC m=+257.274133254" Jun 09 21:49:30.299255 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:30.299152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" event={"ID":"7f11ce06-9742-40d3-a2d6-2f54f51a38ba","Type":"ContainerStarted","Data":"3b183939b331bf19f29e13a57c6a478803f500bf162c4a29e63b043bd08bdf2d"} Jun 09 21:49:30.299255 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:30.299245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:30.303864 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:30.303829 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" Jun 09 21:49:30.314541 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:30.314498 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rmc4t" podStartSLOduration=3.381887245 podStartE2EDuration="4.314484695s" totalImagesPullingTime="932.59745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:30.313485794 +0000 UTC m=+258.280954646" watchObservedRunningTime="2026-06-09 21:49:30.314484695 +0000 UTC m=+258.281953535" Jun 09 21:49:31.021571 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.021537 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-s28tg"] Jun 09 21:49:31.024819 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.024801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.027257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.027239 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 21:49:31.028223 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.028196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 21:49:31.028316 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.028263 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 21:49:31.028399 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.028379 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tmg78\"" Jun 09 21:49:31.032867 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.032849 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-s28tg"] Jun 09 21:49:31.107331 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.107296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.107491 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.107344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.107491 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.107366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d23452-b4f3-41d2-8a1a-368d394a5717-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.107491 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.107418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8c4\" (UniqueName: \"kubernetes.io/projected/c9d23452-b4f3-41d2-8a1a-368d394a5717-kube-api-access-xb8c4\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.208531 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.208499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.208721 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.208548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.208721 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.208565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d23452-b4f3-41d2-8a1a-368d394a5717-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.208721 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.208587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8c4\" (UniqueName: \"kubernetes.io/projected/c9d23452-b4f3-41d2-8a1a-368d394a5717-kube-api-access-xb8c4\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.209281 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.209259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d23452-b4f3-41d2-8a1a-368d394a5717-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.211077 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.211053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.211077 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.211062 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d23452-b4f3-41d2-8a1a-368d394a5717-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.215624 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.215593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8c4\" (UniqueName: \"kubernetes.io/projected/c9d23452-b4f3-41d2-8a1a-368d394a5717-kube-api-access-xb8c4\") pod \"prometheus-operator-7f7d445d84-s28tg\" (UID: \"c9d23452-b4f3-41d2-8a1a-368d394a5717\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.334463 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.334385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" Jun 09 21:49:31.456775 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:31.456615 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-s28tg"] Jun 09 21:49:31.459156 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:31.459129 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d23452_b4f3_41d2_8a1a_368d394a5717.slice/crio-d9384bdc26f1574ae57744b668eb0146127159b817a28da3f7ef30d773242d1f WatchSource:0}: Error finding container d9384bdc26f1574ae57744b668eb0146127159b817a28da3f7ef30d773242d1f: Status 404 returned error can't find the container with id d9384bdc26f1574ae57744b668eb0146127159b817a28da3f7ef30d773242d1f Jun 09 21:49:32.307132 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:32.307089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" event={"ID":"c9d23452-b4f3-41d2-8a1a-368d394a5717","Type":"ContainerStarted","Data":"d9384bdc26f1574ae57744b668eb0146127159b817a28da3f7ef30d773242d1f"} Jun 09 21:49:33.312198 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:33.312160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" event={"ID":"c9d23452-b4f3-41d2-8a1a-368d394a5717","Type":"ContainerStarted","Data":"5074eb852bc0ec7a1193f9b217b65cde1c5907765419a8ad74f80a4599e91e5e"} Jun 09 21:49:33.312572 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:33.312214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" event={"ID":"c9d23452-b4f3-41d2-8a1a-368d394a5717","Type":"ContainerStarted","Data":"2be5fe57ec8e0d9139b9fb54adb26655322487cfcddc3ef355cb00bbcea6f97b"} Jun 09 21:49:33.330542 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:33.330500 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-s28tg" podStartSLOduration=1.18908853 podStartE2EDuration="2.330486852s" totalImagesPullingTime="1.141398322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:33.329294741 +0000 UTC m=+261.296763584" watchObservedRunningTime="2026-06-09 21:49:33.330486852 +0000 UTC m=+261.297955730" Jun 09 21:49:34.944550 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:34.944517 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:34.944932 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:34.944570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:49:34.945778 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:34.945751 2579 patch_prober.go:28] interesting pod/console-86899b98df-h54zh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jun 09 21:49:34.945903 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:34.945799 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86899b98df-h54zh" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jun 09 21:49:35.357193 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.357116 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9"] Jun 09 21:49:35.361971 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.361950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.364606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.364581 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 21:49:35.364750 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.364607 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 21:49:35.364750 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.364621 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r42lf\"" Jun 09 21:49:35.369693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.369608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9"] Jun 09 21:49:35.392002 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.391969 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-67nqm"] Jun 09 21:49:35.395107 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.395085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.397464 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.397310 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwngx\"" Jun 09 21:49:35.397464 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.397341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 21:49:35.397464 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.397351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 21:49:35.397464 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.397315 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 21:49:35.444023 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.443993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-tls\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444023 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-wtmp\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-root\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.444379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-textfile\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2jq5\" (UniqueName: \"kubernetes.io/projected/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-kube-api-access-g2jq5\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-sys\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.444575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.444575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-metrics-client-ca\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.444575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.444475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r25j\" (UniqueName: \"kubernetes.io/projected/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-kube-api-access-8r25j\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.545346 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-tls\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545346 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-wtmp\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545582 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545582 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-root\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545582 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-root\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545582 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-wtmp\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545840 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.545840 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-textfile\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545840 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545840 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2jq5\" (UniqueName: \"kubernetes.io/projected/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-kube-api-access-g2jq5\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.545840 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-sys\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.546070 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.546070 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.546070 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-metrics-client-ca\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.546070 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.545969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r25j\" (UniqueName: \"kubernetes.io/projected/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-kube-api-access-8r25j\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.546299 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.546276 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.546362 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.546349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-sys\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.546559 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.546532 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.546802 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.546781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-textfile\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.546913 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:35.546835 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 21:49:35.547055 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:35.547044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls podName:9b0ef58b-1d1e-4b94-8156-3035da1d73f6 nodeName:}" failed. No retries permitted until 2026-06-09 21:49:36.047023313 +0000 UTC m=+264.014492143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-w8ts9" (UID: "9b0ef58b-1d1e-4b94-8156-3035da1d73f6") : secret "openshift-state-metrics-tls" not found Jun 09 21:49:35.547451 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.547431 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-metrics-client-ca\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.548258 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.548238 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.548676 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.548658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-node-exporter-tls\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.549078 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.549059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.553107 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.553083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2jq5\" (UniqueName: \"kubernetes.io/projected/69c24e4f-5d9e-4430-be91-8fe3012ce3f0-kube-api-access-g2jq5\") pod \"node-exporter-67nqm\" (UID: \"69c24e4f-5d9e-4430-be91-8fe3012ce3f0\") " pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.553241 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.553221 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r25j\" (UniqueName: \"kubernetes.io/projected/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-kube-api-access-8r25j\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:35.706316 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:35.706287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67nqm" Jun 09 21:49:35.718417 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:35.718384 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c24e4f_5d9e_4430_be91_8fe3012ce3f0.slice/crio-ee8d438524a9993667a9ec57ebf92b80053c0eaf5e1d964cc16196da130e34a4 WatchSource:0}: Error finding container ee8d438524a9993667a9ec57ebf92b80053c0eaf5e1d964cc16196da130e34a4: Status 404 returned error can't find the container with id ee8d438524a9993667a9ec57ebf92b80053c0eaf5e1d964cc16196da130e34a4 Jun 09 21:49:36.049872 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:36.049786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:36.052458 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:36.052433 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0ef58b-1d1e-4b94-8156-3035da1d73f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-w8ts9\" (UID: \"9b0ef58b-1d1e-4b94-8156-3035da1d73f6\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:36.272953 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:36.272912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" Jun 09 21:49:36.331302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:36.331007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67nqm" event={"ID":"69c24e4f-5d9e-4430-be91-8fe3012ce3f0","Type":"ContainerStarted","Data":"ee8d438524a9993667a9ec57ebf92b80053c0eaf5e1d964cc16196da130e34a4"} Jun 09 21:49:36.440178 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:36.440077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9"] Jun 09 21:49:36.618783 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:36.618720 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0ef58b_1d1e_4b94_8156_3035da1d73f6.slice/crio-75da2a31758d8d0734b4caa5d7a45e6cd15e3bcb9a1081ca03ddf54282883adc WatchSource:0}: Error finding container 75da2a31758d8d0734b4caa5d7a45e6cd15e3bcb9a1081ca03ddf54282883adc: Status 404 returned error can't find the container with id 75da2a31758d8d0734b4caa5d7a45e6cd15e3bcb9a1081ca03ddf54282883adc Jun 09 21:49:37.337089 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:37.337058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" event={"ID":"9b0ef58b-1d1e-4b94-8156-3035da1d73f6","Type":"ContainerStarted","Data":"8456d5bba6620996fb76eaf7048becaacdd8bbf4862b5555621df975c7bb75f9"} Jun 09 21:49:37.337575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:37.337123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" event={"ID":"9b0ef58b-1d1e-4b94-8156-3035da1d73f6","Type":"ContainerStarted","Data":"e1348133bccddb4248f176f23e73f1f6ceb3ebd3fa6998b19caa98179c609b21"} Jun 09 21:49:37.337575 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:37.337160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" event={"ID":"9b0ef58b-1d1e-4b94-8156-3035da1d73f6","Type":"ContainerStarted","Data":"75da2a31758d8d0734b4caa5d7a45e6cd15e3bcb9a1081ca03ddf54282883adc"} Jun 09 21:49:37.338871 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:37.338848 2579 generic.go:356] "Generic (PLEG): container finished" podID="69c24e4f-5d9e-4430-be91-8fe3012ce3f0" containerID="00307fcacc02e7332ab486e70aa960a5de683f7d3b20dc8ef827ffed8dfc0df6" exitCode=0 Jun 09 21:49:37.338991 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:37.338916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67nqm" event={"ID":"69c24e4f-5d9e-4430-be91-8fe3012ce3f0","Type":"ContainerDied","Data":"00307fcacc02e7332ab486e70aa960a5de683f7d3b20dc8ef827ffed8dfc0df6"} Jun 09 21:49:38.351258 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:38.351175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67nqm" event={"ID":"69c24e4f-5d9e-4430-be91-8fe3012ce3f0","Type":"ContainerStarted","Data":"5b1044d17a4c7e993e318b40a9d80f55fa4523642e54966c95d96579172892b5"} Jun 09 21:49:38.351745 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:38.351275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67nqm" event={"ID":"69c24e4f-5d9e-4430-be91-8fe3012ce3f0","Type":"ContainerStarted","Data":"a2ed28fc9e078a20517817b7a7e660b9ce1e0e8933457bdf86959f2c224827b4"} Jun 09 21:49:38.356617 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:38.356588 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" event={"ID":"9b0ef58b-1d1e-4b94-8156-3035da1d73f6","Type":"ContainerStarted","Data":"5e01e46d8883f86c612a76596047f9f34fa569eb8b1a5228844fc0352286a21c"} Jun 09 21:49:38.370557 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:38.370508 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-67nqm" podStartSLOduration=2.352018597 podStartE2EDuration="3.370494342s" totalImagesPullingTime="946.450667ms" totalInitContainerRuntime="72.025078ms" isStatefulPod=true podCreationTimestamp="2026-06-09 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:38.368355763 +0000 UTC m=+266.335824602" watchObservedRunningTime="2026-06-09 21:49:38.370494342 +0000 UTC m=+266.337963180" Jun 09 21:49:38.385081 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:38.385038 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-w8ts9" podStartSLOduration=2.545178539 podStartE2EDuration="3.385025004s" totalImagesPullingTime="839.846465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:38.383724478 +0000 UTC m=+266.351193319" watchObservedRunningTime="2026-06-09 21:49:38.385025004 +0000 UTC m=+266.352493844" Jun 09 21:49:40.148201 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.148168 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7znlq"] Jun 09 21:49:40.151548 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.151527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.153854 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.153829 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p9jh8\"" Jun 09 21:49:40.153854 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.153842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 21:49:40.159987 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.159965 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7znlq"] Jun 09 21:49:40.283734 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.283703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.283889 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.283762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2f4\" (UniqueName: \"kubernetes.io/projected/e6f451cc-e35f-4672-ad99-c6bfc3a67473-kube-api-access-bb2f4\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.384688 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.384636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.384823 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.384730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2f4\" (UniqueName: \"kubernetes.io/projected/e6f451cc-e35f-4672-ad99-c6bfc3a67473-kube-api-access-bb2f4\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.384823 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:40.384781 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 21:49:40.384906 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:40.384858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert podName:e6f451cc-e35f-4672-ad99-c6bfc3a67473 nodeName:}" failed. No retries permitted until 2026-06-09 21:49:40.884838073 +0000 UTC m=+268.852306905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-7znlq" (UID: "e6f451cc-e35f-4672-ad99-c6bfc3a67473") : secret "monitoring-plugin-cert" not found Jun 09 21:49:40.393189 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.393162 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2f4\" (UniqueName: \"kubernetes.io/projected/e6f451cc-e35f-4672-ad99-c6bfc3a67473-kube-api-access-bb2f4\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.888587 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.888555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:40.890939 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:40.890915 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6f451cc-e35f-4672-ad99-c6bfc3a67473-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7znlq\" (UID: \"e6f451cc-e35f-4672-ad99-c6bfc3a67473\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:41.061783 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.061743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:41.180083 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.180059 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7znlq"] Jun 09 21:49:41.182228 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:41.182200 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f451cc_e35f_4672_ad99_c6bfc3a67473.slice/crio-4f13709462ff0abbd9198a205f13cec52e380b132e5521c36664bc003b4a5025 WatchSource:0}: Error finding container 4f13709462ff0abbd9198a205f13cec52e380b132e5521c36664bc003b4a5025: Status 404 returned error can't find the container with id 4f13709462ff0abbd9198a205f13cec52e380b132e5521c36664bc003b4a5025 Jun 09 21:49:41.370110 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.370073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" event={"ID":"e6f451cc-e35f-4672-ad99-c6bfc3a67473","Type":"ContainerStarted","Data":"4f13709462ff0abbd9198a205f13cec52e380b132e5521c36664bc003b4a5025"} Jun 09 21:49:41.557942 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.557855 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 21:49:41.564039 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.564017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.568457 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.568425 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 21:49:41.568592 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.568425 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 21:49:41.568592 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.568498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 21:49:41.568724 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.568680 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 21:49:41.568815 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.568794 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9rkihkijr1p0e\"" Jun 09 21:49:41.569217 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569199 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 21:49:41.569524 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 21:49:41.569524 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569516 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 21:49:41.569674 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 21:49:41.569674 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569564 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 21:49:41.569674 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.569630 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 21:49:41.574825 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.574621 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 21:49:41.575768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.575744 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 21:49:41.576081 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.575951 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 21:49:41.576081 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.575969 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xgvnc\"" Jun 09 21:49:41.576081 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.576035 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 21:49:41.577427 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.577410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 21:49:41.586420 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.586400 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 21:49:41.695768 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-config-out\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd2h8\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-kube-api-access-pd2h8\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.695946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-web-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.695974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696439 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696439 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696439 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.696439 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.696284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-config-out\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd2h8\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-kube-api-access-pd2h8\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.796998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-web-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.797348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.797048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.799166 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.799136 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800411 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800559 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800711 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800711 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800817 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800817 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800817 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.800948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.800891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.801171 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.801144 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.801565 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.801533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.803169 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.802269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.803169 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.802767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d12f1462-63d3-4481-8e44-5fc9aa641180-config-out\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.804992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.803703 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.804992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.804096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.804992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.804242 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.804992 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.804613 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.808446 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.808337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.809956 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.808621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.812612 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.812585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.813068 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.813039 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.814359 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.814309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.814983 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.814957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d12f1462-63d3-4481-8e44-5fc9aa641180-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.816455 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.816413 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-web-config\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.816721 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.816701 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.816906 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.816834 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.817269 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.816833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd2h8\" (UniqueName: \"kubernetes.io/projected/d12f1462-63d3-4481-8e44-5fc9aa641180-kube-api-access-pd2h8\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.818341 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.818298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d12f1462-63d3-4481-8e44-5fc9aa641180-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d12f1462-63d3-4481-8e44-5fc9aa641180\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:41.843666 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.843600 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:49:41.874946 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:41.874918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:42.043207 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:42.043047 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 21:49:42.046405 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:42.046376 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12f1462_63d3_4481_8e44_5fc9aa641180.slice/crio-8afac607f755903e6e7b3b157f96b6ce12a296b3899e78fe37566c8a859da43e WatchSource:0}: Error finding container 8afac607f755903e6e7b3b157f96b6ce12a296b3899e78fe37566c8a859da43e: Status 404 returned error can't find the container with id 8afac607f755903e6e7b3b157f96b6ce12a296b3899e78fe37566c8a859da43e Jun 09 21:49:42.376141 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:42.376070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"8afac607f755903e6e7b3b157f96b6ce12a296b3899e78fe37566c8a859da43e"} Jun 09 21:49:43.381765 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.381720 2579 generic.go:356] "Generic (PLEG): container finished" podID="d12f1462-63d3-4481-8e44-5fc9aa641180" containerID="bc3ab139adee8bd5a7676afcd43c3496f383fb131855e117d508dc8eacc52923" exitCode=0 Jun 09 21:49:43.382183 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.381806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerDied","Data":"bc3ab139adee8bd5a7676afcd43c3496f383fb131855e117d508dc8eacc52923"} Jun 09 21:49:43.383560 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.383435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" event={"ID":"e6f451cc-e35f-4672-ad99-c6bfc3a67473","Type":"ContainerStarted","Data":"a8cb717a58687f6f0bcf8b1508ce30c073514839f1d3dee039b1ede8eba87c4f"} Jun 09 21:49:43.383678 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.383659 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:43.388422 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.388393 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" Jun 09 21:49:43.417673 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:43.417584 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7znlq" podStartSLOduration=2.048294983 podStartE2EDuration="3.417571283s" totalImagesPullingTime="1.3692763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:43.417156456 +0000 UTC m=+271.384625296" watchObservedRunningTime="2026-06-09 21:49:43.417571283 +0000 UTC m=+271.385040122" Jun 09 21:49:47.403345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:47.403308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"c424b3fb2acdb32f0956a5214625eaee3fe6791d1e5b25c648ca0064dcdfc71d"} Jun 09 21:49:47.403765 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:47.403390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"b10e8ba697dc4aa0e1fd0b6b67794802a28d287ab7d423a9cefefd11dfc94295"} Jun 09 21:49:49.115736 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.115704 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:49:49.118943 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.118927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.126698 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.126676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:49:49.126859 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.126841 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 21:49:49.277376 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqfr\" (UniqueName: \"kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.277693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.277595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378216 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378345 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqfr\" (UniqueName: \"kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378537 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.378537 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.378506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.379136 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.379046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.379136 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.379102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.379309 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.379143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.379371 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.379353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.380784 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.380758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.380857 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.380824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.385754 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.385734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqfr\" (UniqueName: \"kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr\") pod \"console-6544c8d4f6-h7tzm\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.419278 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.419254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"2575a5266cd262f4cf87fb80b9df6dfc61e64efce4abe7b3a022da4b03273513"} Jun 09 21:49:49.419394 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.419330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"3de1777ac30251ef9605a8b4bbcb1db07f779c66f94101861f66c1d43830d829"} Jun 09 21:49:49.419394 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.419358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"04a9b0d41fda80dfbfb2be333c6ab23b9fe546e8cd56149b78164879d79055b5"} Jun 09 21:49:49.419394 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.419384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d12f1462-63d3-4481-8e44-5fc9aa641180","Type":"ContainerStarted","Data":"2be80b92e670624f75fe40f3b341d78f552446c84de32b20ae5350d30190807f"} Jun 09 21:49:49.429000 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.428978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:49.446699 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.446625 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.252947523 podStartE2EDuration="8.446603475s" totalImagesPullingTime="6.176529075s" totalInitContainerRuntime="17.126877ms" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:49.445478217 +0000 UTC m=+277.412947108" watchObservedRunningTime="2026-06-09 21:49:49.446603475 +0000 UTC m=+277.414072317" Jun 09 21:49:49.565487 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:49.565448 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:49:50.425336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:50.425304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544c8d4f6-h7tzm" event={"ID":"6ffebffb-0747-45d9-a8c2-5184ba084a13","Type":"ContainerStarted","Data":"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a"} Jun 09 21:49:50.425719 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:50.425356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544c8d4f6-h7tzm" event={"ID":"6ffebffb-0747-45d9-a8c2-5184ba084a13","Type":"ContainerStarted","Data":"2c0a8d68b2e5ba24128373dd646c627b70be1dd5a12ed050807f62cc3987d892"} Jun 09 21:49:50.442701 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:50.442655 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6544c8d4f6-h7tzm" podStartSLOduration=1.442623372 podStartE2EDuration="1.442623372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:50.441036055 +0000 UTC m=+278.408504895" watchObservedRunningTime="2026-06-09 21:49:50.442623372 +0000 UTC m=+278.410092211" Jun 09 21:49:51.875974 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:51.875927 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:49:53.985706 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:53.985626 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hsrx4" podUID="c2b24534-d98f-4c43-8745-9eed725d9bef" Jun 09 21:49:53.985706 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:49:53.985662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" Jun 09 21:49:54.439465 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:54.439435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:49:54.439634 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:54.439445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:49:57.862722 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:57.862688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:49:57.863178 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:57.862804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:49:57.865123 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:57.865095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2b24534-d98f-4c43-8745-9eed725d9bef-metrics-tls\") pod \"dns-default-hsrx4\" (UID: \"c2b24534-d98f-4c43-8745-9eed725d9bef\") " pod="openshift-dns/dns-default-hsrx4" Jun 09 21:49:57.865226 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:57.865160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"image-registry-77bb7fd8c7-wcwlp\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:49:58.043556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.043527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2zngw\"" Jun 09 21:49:58.043716 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.043529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qwpdx\"" Jun 09 21:49:58.050554 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.050538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:49:58.050676 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.050658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:49:58.195107 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.195077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:49:58.198201 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:49:58.198175 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e015646_baaa_40e4_9b93_9f0dac91a1ad.slice/crio-a3e0d0a961d9d5168e0a47bcecf5efc3addf5c9a56428af6dbc5bb5bc554ff55 WatchSource:0}: Error finding container a3e0d0a961d9d5168e0a47bcecf5efc3addf5c9a56428af6dbc5bb5bc554ff55: Status 404 returned error can't find the container with id a3e0d0a961d9d5168e0a47bcecf5efc3addf5c9a56428af6dbc5bb5bc554ff55 Jun 09 21:49:58.215360 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.215240 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsrx4"] Jun 09 21:49:58.455862 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.455754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" event={"ID":"9e015646-baaa-40e4-9b93-9f0dac91a1ad","Type":"ContainerStarted","Data":"51abf06fed9e206c190d7274bee544c3fe2aac73fa5c5834f011f99fb7884d0a"} Jun 09 21:49:58.455862 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.455824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" event={"ID":"9e015646-baaa-40e4-9b93-9f0dac91a1ad","Type":"ContainerStarted","Data":"a3e0d0a961d9d5168e0a47bcecf5efc3addf5c9a56428af6dbc5bb5bc554ff55"} Jun 09 21:49:58.456080 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.455992 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:49:58.456947 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.456923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsrx4" event={"ID":"c2b24534-d98f-4c43-8745-9eed725d9bef","Type":"ContainerStarted","Data":"108cb067b2577337aaa66ab88e2ab486ba936b3c0e06bbe12444e123e3328104"} Jun 09 21:49:58.474161 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:58.474099 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" podStartSLOduration=285.474085515 podStartE2EDuration="4m45.474085515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:58.472446346 +0000 UTC m=+286.439915187" watchObservedRunningTime="2026-06-09 21:49:58.474085515 +0000 UTC m=+286.441554354" Jun 09 21:49:59.429479 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:59.429444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:59.429877 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:59.429755 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:49:59.431069 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:59.431046 2579 patch_prober.go:28] interesting pod/console-6544c8d4f6-h7tzm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 09 21:49:59.431178 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:49:59.431087 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6544c8d4f6-h7tzm" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 09 21:50:00.468104 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:00.468069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsrx4" event={"ID":"c2b24534-d98f-4c43-8745-9eed725d9bef","Type":"ContainerStarted","Data":"9f4315f7e8925ba89e978726bfa8244368148b975e5bdeebcb37c2b554e45657"} Jun 09 21:50:00.468506 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:00.468119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsrx4" event={"ID":"c2b24534-d98f-4c43-8745-9eed725d9bef","Type":"ContainerStarted","Data":"2dc3861cb00d6ee12c06f195eaeea8338429e7bd32a1bf2d655c82dc4e0016a3"} Jun 09 21:50:00.468506 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:00.468187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:50:00.487594 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:00.487548 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hsrx4" podStartSLOduration=251.750935896 podStartE2EDuration="4m13.487532092s" totalImagesPullingTime="1.736596196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:50:00.486704822 +0000 UTC m=+288.454173663" watchObservedRunningTime="2026-06-09 21:50:00.487532092 +0000 UTC m=+288.455000913" Jun 09 21:50:06.872634 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:06.872572 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86899b98df-h54zh" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerName="console" containerID="cri-o://85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2" gracePeriod=15 Jun 09 21:50:09.429692 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:09.429635 2579 patch_prober.go:28] interesting pod/console-6544c8d4f6-h7tzm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 09 21:50:09.430111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:09.429709 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6544c8d4f6-h7tzm" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 09 21:50:10.473883 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:10.473855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hsrx4" Jun 09 21:50:12.445584 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.445560 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:50:12.446115 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.445632 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:50:12.456811 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.456791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:50:12.456811 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.456791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:50:12.460405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.460389 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 21:50:12.517066 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.516938 2579 generic.go:356] "Generic (PLEG): container finished" podID="3cf1bda3-8126-41f0-a126-470f335894c5" containerID="b0d3424768e6e357b1eee7baa9254b61d4294b0b9a927fc047c5fca4ae523d21" exitCode=0 Jun 09 21:50:12.517066 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.516972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ch7hk" event={"ID":"3cf1bda3-8126-41f0-a126-470f335894c5","Type":"ContainerDied","Data":"b0d3424768e6e357b1eee7baa9254b61d4294b0b9a927fc047c5fca4ae523d21"} Jun 09 21:50:12.521182 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:12.517264 2579 scope.go:117] "RemoveContainer" containerID="b0d3424768e6e357b1eee7baa9254b61d4294b0b9a927fc047c5fca4ae523d21" Jun 09 21:50:13.521989 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:13.521956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ch7hk" event={"ID":"3cf1bda3-8126-41f0-a126-470f335894c5","Type":"ContainerStarted","Data":"7602df6ae85dd0e4f2036f4139ddd3570bb4a1316605e5e1379988d1ffae9642"} Jun 09 21:50:14.504894 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.504870 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:50:14.527885 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.527852 2579 generic.go:356] "Generic (PLEG): container finished" podID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerID="85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2" exitCode=0 Jun 09 21:50:14.527885 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.527886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86899b98df-h54zh" event={"ID":"577db27d-d803-4a8c-a0f6-07e78fc5a767","Type":"ContainerDied","Data":"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2"} Jun 09 21:50:14.528257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.527894 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86899b98df-h54zh" Jun 09 21:50:14.528257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.527919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86899b98df-h54zh" event={"ID":"577db27d-d803-4a8c-a0f6-07e78fc5a767","Type":"ContainerDied","Data":"9a56d5a2aafe71e63d3c8b84d90a4f7a96e1307c69ce623937d9be88d7fbc046"} Jun 09 21:50:14.528257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.527942 2579 scope.go:117] "RemoveContainer" containerID="85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2" Jun 09 21:50:14.536233 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.536216 2579 scope.go:117] "RemoveContainer" containerID="85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2" Jun 09 21:50:14.536526 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:50:14.536498 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2\": container with ID starting with 85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2 not found: ID does not exist" containerID="85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2" Jun 09 21:50:14.536579 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.536540 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2"} err="failed to get container status \"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2\": rpc error: code = NotFound desc = could not find container \"85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2\": container with ID starting with 85c3cafcd19ab5b1d109ef6e6eaecd6c9b91fb4293058f8a1a5cf0e393d2c5d2 not found: ID does not exist" Jun 09 21:50:14.614183 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614098 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sczzv\" (UniqueName: \"kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614183 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614188 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614214 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614246 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614283 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert\") pod \"577db27d-d803-4a8c-a0f6-07e78fc5a767\" (UID: \"577db27d-d803-4a8c-a0f6-07e78fc5a767\") " Jun 09 21:50:14.614704 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614618 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config" (OuterVolumeSpecName: "console-config") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.614827 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614717 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.614827 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.614779 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca" (OuterVolumeSpecName: "service-ca") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.616718 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.616696 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:14.616829 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.616811 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:14.616902 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.616879 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv" (OuterVolumeSpecName: "kube-api-access-sczzv") pod "577db27d-d803-4a8c-a0f6-07e78fc5a767" (UID: "577db27d-d803-4a8c-a0f6-07e78fc5a767"). InnerVolumeSpecName "kube-api-access-sczzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:50:14.715092 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715063 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-oauth-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.715092 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715089 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-serving-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.715092 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715099 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sczzv\" (UniqueName: \"kubernetes.io/projected/577db27d-d803-4a8c-a0f6-07e78fc5a767-kube-api-access-sczzv\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.715289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715107 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-oauth-serving-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.715289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715116 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-console-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.715289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.715128 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/577db27d-d803-4a8c-a0f6-07e78fc5a767-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.848758 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.848732 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:50:14.852282 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:14.852257 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86899b98df-h54zh"] Jun 09 21:50:16.512962 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:16.512928 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" path="/var/lib/kubelet/pods/577db27d-d803-4a8c-a0f6-07e78fc5a767/volumes" Jun 09 21:50:16.861567 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:16.861542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-d7slq_92724e1f-bee6-4b01-a17f-ef6ad42dad4f/cluster-monitoring-operator/0.log" Jun 09 21:50:17.544194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:17.544156 2579 generic.go:356] "Generic (PLEG): container finished" podID="d95c54fe-63e9-428a-9e33-c2d01d9f7831" containerID="737f69df719ae4c2f36ae3d531c5d455e787f97390d6dd886a16065b083a0270" exitCode=0 Jun 09 21:50:17.544595 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:17.544229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" event={"ID":"d95c54fe-63e9-428a-9e33-c2d01d9f7831","Type":"ContainerDied","Data":"737f69df719ae4c2f36ae3d531c5d455e787f97390d6dd886a16065b083a0270"} Jun 09 21:50:17.544595 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:17.544580 2579 scope.go:117] "RemoveContainer" containerID="737f69df719ae4c2f36ae3d531c5d455e787f97390d6dd886a16065b083a0270" Jun 09 21:50:17.859488 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:17.859412 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-7znlq_e6f451cc-e35f-4672-ad99-c6bfc3a67473/monitoring-plugin/0.log" Jun 09 21:50:18.055957 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.055914 2579 patch_prober.go:28] interesting pod/image-registry-77bb7fd8c7-wcwlp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:50:18.056104 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.055977 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:50:18.059731 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.059712 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/init-textfile/0.log" Jun 09 21:50:18.260339 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.260308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/node-exporter/0.log" Jun 09 21:50:18.460489 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.460463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/kube-rbac-proxy/0.log" Jun 09 21:50:18.550135 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:18.550056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-nn25g" event={"ID":"d95c54fe-63e9-428a-9e33-c2d01d9f7831","Type":"ContainerStarted","Data":"5a029cdeceec7a841f8e0907d678dd76600e61066d7f922cdb5af593359a7389"} Jun 09 21:50:19.433554 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:19.433525 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:50:19.437344 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:19.437321 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:50:19.466138 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:19.466112 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:50:19.859905 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:19.859822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/kube-rbac-proxy-main/0.log" Jun 09 21:50:20.060606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.060576 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/kube-rbac-proxy-self/0.log" Jun 09 21:50:20.259497 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.259466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/openshift-state-metrics/0.log" Jun 09 21:50:20.460359 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.460329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/init-config-reloader/0.log" Jun 09 21:50:20.526890 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.526807 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:50:20.661563 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.661541 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/prometheus/0.log" Jun 09 21:50:20.861674 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:20.861574 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/config-reloader/0.log" Jun 09 21:50:21.061206 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:21.061177 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/thanos-sidecar/0.log" Jun 09 21:50:21.260303 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:21.260274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy-web/0.log" Jun 09 21:50:21.459808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:21.459776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy/0.log" Jun 09 21:50:21.659781 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:21.659752 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy-thanos/0.log" Jun 09 21:50:21.861344 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:21.861319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-s28tg_c9d23452-b4f3-41d2-8a1a-368d394a5717/prometheus-operator/0.log" Jun 09 21:50:22.062336 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:22.062255 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-s28tg_c9d23452-b4f3-41d2-8a1a-368d394a5717/kube-rbac-proxy/0.log" Jun 09 21:50:22.260061 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:22.260035 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-rmc4t_7f11ce06-9742-40d3-a2d6-2f54f51a38ba/prometheus-operator-admission-webhook/0.log" Jun 09 21:50:24.460666 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:24.460619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:50:24.662636 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:24.662599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/2.log" Jun 09 21:50:25.060368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:25.060337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6544c8d4f6-h7tzm_6ffebffb-0747-45d9-a8c2-5184ba084a13/console/0.log" Jun 09 21:50:25.859839 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:25.859806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsrx4_c2b24534-d98f-4c43-8745-9eed725d9bef/dns/0.log" Jun 09 21:50:26.060850 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:26.060826 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsrx4_c2b24534-d98f-4c43-8745-9eed725d9bef/kube-rbac-proxy/0.log" Jun 09 21:50:27.260377 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:27.260351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8kfpb_8d7a06ef-dead-4d46-a19a-2ab0f4fe776a/dns-node-resolver/0.log" Jun 09 21:50:27.860027 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:27.859998 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77bb7fd8c7-wcwlp_9e015646-baaa-40e4-9b93-9f0dac91a1ad/registry/0.log" Jun 09 21:50:28.259870 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:28.259843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xv7h_2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c/node-ca/0.log" Jun 09 21:50:28.661057 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:28.661029 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 21:50:29.260503 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:29.260476 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxml9_0497a465-bc63-4882-9fd5-9270917d73e4/serve-healthcheck-canary/0.log" Jun 09 21:50:41.875266 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:41.875230 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:50:41.891029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:41.891002 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:50:42.659239 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:42.659212 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:50:45.546956 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:45.546895 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerName="registry" containerID="cri-o://51abf06fed9e206c190d7274bee544c3fe2aac73fa5c5834f011f99fb7884d0a" gracePeriod=30 Jun 09 21:50:46.659479 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.659451 2579 generic.go:356] "Generic (PLEG): container finished" podID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerID="51abf06fed9e206c190d7274bee544c3fe2aac73fa5c5834f011f99fb7884d0a" exitCode=0 Jun 09 21:50:46.659821 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.659523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" event={"ID":"9e015646-baaa-40e4-9b93-9f0dac91a1ad","Type":"ContainerDied","Data":"51abf06fed9e206c190d7274bee544c3fe2aac73fa5c5834f011f99fb7884d0a"} Jun 09 21:50:46.787930 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.787908 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:50:46.982526 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982495 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.982739 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982541 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.982739 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982568 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.982739 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982585 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.982739 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982623 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.982739 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982668 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.983065 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xh7p\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.983065 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.982866 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token\") pod \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\" (UID: \"9e015646-baaa-40e4-9b93-9f0dac91a1ad\") " Jun 09 21:50:46.983160 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.983130 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:46.983214 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.983166 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:46.985251 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.985182 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:50:46.985422 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.985394 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:46.985536 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.985449 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p" (OuterVolumeSpecName: "kube-api-access-7xh7p") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "kube-api-access-7xh7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:50:46.985603 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.985581 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:46.985789 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.985771 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:50:46.991180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:46.991158 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e015646-baaa-40e4-9b93-9f0dac91a1ad" (UID: "9e015646-baaa-40e4-9b93-9f0dac91a1ad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:50:47.083628 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083601 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-certificates\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083628 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083627 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-registry-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083635 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xh7p\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-kube-api-access-7xh7p\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083671 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e015646-baaa-40e4-9b93-9f0dac91a1ad-bound-sa-token\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083680 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e015646-baaa-40e4-9b93-9f0dac91a1ad-ca-trust-extracted\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083688 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e015646-baaa-40e4-9b93-9f0dac91a1ad-trusted-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083698 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-installation-pull-secrets\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.083813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.083706 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e015646-baaa-40e4-9b93-9f0dac91a1ad-image-registry-private-configuration\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:50:47.663820 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.663792 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" Jun 09 21:50:47.664210 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.663830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb7fd8c7-wcwlp" event={"ID":"9e015646-baaa-40e4-9b93-9f0dac91a1ad","Type":"ContainerDied","Data":"a3e0d0a961d9d5168e0a47bcecf5efc3addf5c9a56428af6dbc5bb5bc554ff55"} Jun 09 21:50:47.664210 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.663888 2579 scope.go:117] "RemoveContainer" containerID="51abf06fed9e206c190d7274bee544c3fe2aac73fa5c5834f011f99fb7884d0a" Jun 09 21:50:47.684200 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.684176 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:50:47.687909 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:47.687887 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77bb7fd8c7-wcwlp"] Jun 09 21:50:48.512988 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:50:48.512952 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" path="/var/lib/kubelet/pods/9e015646-baaa-40e4-9b93-9f0dac91a1ad/volumes" Jun 09 21:51:17.365683 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:17.364089 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:51:42.388303 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.388255 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6544c8d4f6-h7tzm" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" containerID="cri-o://545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a" gracePeriod=15 Jun 09 21:51:42.631130 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.631106 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:51:42.731828 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731747 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.731828 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731787 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.731828 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.732088 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731833 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhqfr\" (UniqueName: \"kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.732088 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731916 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.732088 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731941 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.732088 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.731961 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert\") pod \"6ffebffb-0747-45d9-a8c2-5184ba084a13\" (UID: \"6ffebffb-0747-45d9-a8c2-5184ba084a13\") " Jun 09 21:51:42.732298 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.732123 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:51:42.732298 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.732285 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config" (OuterVolumeSpecName: "console-config") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:51:42.732533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.732388 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:51:42.732533 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.732434 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:51:42.733968 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.733943 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:51:42.734068 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.733968 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:51:42.734068 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.733987 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr" (OuterVolumeSpecName: "kube-api-access-hhqfr") pod "6ffebffb-0747-45d9-a8c2-5184ba084a13" (UID: "6ffebffb-0747-45d9-a8c2-5184ba084a13"). InnerVolumeSpecName "kube-api-access-hhqfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:51:42.832653 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832616 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832734 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832745 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-oauth-serving-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832755 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-oauth-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832763 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffebffb-0747-45d9-a8c2-5184ba084a13-trusted-ca-bundle\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832772 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ffebffb-0747-45d9-a8c2-5184ba084a13-console-serving-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.832822 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.832779 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhqfr\" (UniqueName: \"kubernetes.io/projected/6ffebffb-0747-45d9-a8c2-5184ba084a13-kube-api-access-hhqfr\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:51:42.875915 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.875885 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerID="545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a" exitCode=0 Jun 09 21:51:42.876047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.875932 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544c8d4f6-h7tzm" Jun 09 21:51:42.876047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.875944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544c8d4f6-h7tzm" event={"ID":"6ffebffb-0747-45d9-a8c2-5184ba084a13","Type":"ContainerDied","Data":"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a"} Jun 09 21:51:42.876047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.875981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544c8d4f6-h7tzm" event={"ID":"6ffebffb-0747-45d9-a8c2-5184ba084a13","Type":"ContainerDied","Data":"2c0a8d68b2e5ba24128373dd646c627b70be1dd5a12ed050807f62cc3987d892"} Jun 09 21:51:42.876047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.876000 2579 scope.go:117] "RemoveContainer" containerID="545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a" Jun 09 21:51:42.884770 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.884754 2579 scope.go:117] "RemoveContainer" containerID="545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a" Jun 09 21:51:42.885011 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:51:42.884993 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a\": container with ID starting with 545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a not found: ID does not exist" containerID="545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a" Jun 09 21:51:42.885053 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.885020 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a"} err="failed to get container status \"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a\": rpc error: code = NotFound desc = could not find container \"545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a\": container with ID starting with 545cdc15fef21c15e8311742d2f12b2ec213ee45d40d9b1bd432f7cfffcee95a not found: ID does not exist" Jun 09 21:51:42.895242 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.895216 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:51:42.898596 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:42.898572 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6544c8d4f6-h7tzm"] Jun 09 21:51:44.514000 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:51:44.513958 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" path="/var/lib/kubelet/pods/6ffebffb-0747-45d9-a8c2-5184ba084a13/volumes" Jun 09 21:52:46.007484 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007454 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-z6fdr"] Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007743 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007754 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007773 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerName="registry" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007779 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerName="registry" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007785 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerName="console" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007790 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerName="console" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007834 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="577db27d-d803-4a8c-a0f6-07e78fc5a767" containerName="console" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007841 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e015646-baaa-40e4-9b93-9f0dac91a1ad" containerName="registry" Jun 09 21:52:46.007948 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.007847 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ffebffb-0747-45d9-a8c2-5184ba084a13" containerName="console" Jun 09 21:52:46.010733 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.010717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.014183 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.014161 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z9fv6\"" Jun 09 21:52:46.014528 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.014511 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 21:52:46.015202 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.015188 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 21:52:46.021101 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.021081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-z6fdr"] Jun 09 21:52:46.130519 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.130493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktgl\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-kube-api-access-zktgl\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.130694 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.130543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-bound-sa-token\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.231902 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.231876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktgl\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-kube-api-access-zktgl\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.232024 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.231922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-bound-sa-token\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.243034 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.243010 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-bound-sa-token\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.243165 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.243111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktgl\" (UniqueName: \"kubernetes.io/projected/73f119e0-a948-4a54-9b05-1336b789b2d5-kube-api-access-zktgl\") pod \"cert-manager-59c77684cc-z6fdr\" (UID: \"73f119e0-a948-4a54-9b05-1336b789b2d5\") " pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.335228 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.335170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-z6fdr" Jun 09 21:52:46.460007 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.459980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-z6fdr"] Jun 09 21:52:46.462507 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:52:46.462479 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73f119e0_a948_4a54_9b05_1336b789b2d5.slice/crio-cf0489697ee16fcb516fbad3559f2bed80e111564564f89e450d57114425a115 WatchSource:0}: Error finding container cf0489697ee16fcb516fbad3559f2bed80e111564564f89e450d57114425a115: Status 404 returned error can't find the container with id cf0489697ee16fcb516fbad3559f2bed80e111564564f89e450d57114425a115 Jun 09 21:52:46.464916 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:46.464899 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:52:47.113581 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:47.113548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-z6fdr" event={"ID":"73f119e0-a948-4a54-9b05-1336b789b2d5","Type":"ContainerStarted","Data":"cf0489697ee16fcb516fbad3559f2bed80e111564564f89e450d57114425a115"} Jun 09 21:52:53.140043 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:53.140007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-z6fdr" event={"ID":"73f119e0-a948-4a54-9b05-1336b789b2d5","Type":"ContainerStarted","Data":"56a4d0a82062a40f827b892c29757404821beada81cd57d445c831e016bdc051"} Jun 09 21:52:53.155442 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:53.155397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-z6fdr" podStartSLOduration=2.211915746 podStartE2EDuration="8.155382283s" totalImagesPullingTime="5.943466537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:52:53.153751734 +0000 UTC m=+461.121220573" watchObservedRunningTime="2026-06-09 21:52:53.155382283 +0000 UTC m=+461.122851122" Jun 09 21:52:55.831519 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.831486 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6"] Jun 09 21:52:55.834608 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.834592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:55.837003 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.836980 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 21:52:55.837984 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.837968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p4vmb\"" Jun 09 21:52:55.838047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.837997 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:52:55.838358 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.838341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 21:52:55.838424 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.838354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 21:52:55.838424 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.838414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 21:52:55.843620 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.843599 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6"] Jun 09 21:52:55.912084 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.912059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:55.912216 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.912099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28997144-f467-4e52-bd57-05f248283752-manager-config\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:55.912216 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.912121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-metrics-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:55.912216 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:55.912194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfxx7\" (UniqueName: \"kubernetes.io/projected/28997144-f467-4e52-bd57-05f248283752-kube-api-access-kfxx7\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.012552 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.012513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.012774 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.012568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28997144-f467-4e52-bd57-05f248283752-manager-config\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.012774 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.012598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-metrics-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.012774 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.012669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfxx7\" (UniqueName: \"kubernetes.io/projected/28997144-f467-4e52-bd57-05f248283752-kube-api-access-kfxx7\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.013256 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.013234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28997144-f467-4e52-bd57-05f248283752-manager-config\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.015185 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.015158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-metrics-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.015293 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.015186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28997144-f467-4e52-bd57-05f248283752-cert\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.021486 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.021466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfxx7\" (UniqueName: \"kubernetes.io/projected/28997144-f467-4e52-bd57-05f248283752-kube-api-access-kfxx7\") pod \"lws-controller-manager-9d96bd75-rj9m6\" (UID: \"28997144-f467-4e52-bd57-05f248283752\") " pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.144192 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.144155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:52:56.273085 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:56.273059 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6"] Jun 09 21:52:56.275468 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:52:56.275435 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28997144_f467_4e52_bd57_05f248283752.slice/crio-0ac51030beb57952993e052cf61bd057427eb5c2acce6e9b39c4815051a4c185 WatchSource:0}: Error finding container 0ac51030beb57952993e052cf61bd057427eb5c2acce6e9b39c4815051a4c185: Status 404 returned error can't find the container with id 0ac51030beb57952993e052cf61bd057427eb5c2acce6e9b39c4815051a4c185 Jun 09 21:52:57.158220 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:57.158183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" event={"ID":"28997144-f467-4e52-bd57-05f248283752","Type":"ContainerStarted","Data":"0ac51030beb57952993e052cf61bd057427eb5c2acce6e9b39c4815051a4c185"} Jun 09 21:52:58.016506 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.016310 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8"] Jun 09 21:52:58.023725 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.023701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.025848 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.025816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwvb\" (UniqueName: \"kubernetes.io/projected/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-kube-api-access-cpwvb\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.025988 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.025873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.026061 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.026184 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.026276 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.026677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 21:52:58.026677 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7gx5\"" Jun 09 21:52:58.026830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026761 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 21:52:58.026882 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.026865 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 21:52:58.027427 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.027231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 21:52:58.037455 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.037433 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8"] Jun 09 21:52:58.127057 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.127233 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.127233 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.127233 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwvb\" (UniqueName: \"kubernetes.io/projected/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-kube-api-access-cpwvb\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.127425 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.127556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.127506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.129584 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.129541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.129915 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.129894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.130050 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.130032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.135806 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.135782 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwvb\" (UniqueName: \"kubernetes.io/projected/2d2fa1cd-827c-4df6-abe6-72a316c32c3d-kube-api-access-cpwvb\") pod \"opendatahub-operator-controller-manager-96bcfd894-rf9w8\" (UID: \"2d2fa1cd-827c-4df6-abe6-72a316c32c3d\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.338853 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.338783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:52:58.675468 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:58.675440 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8"] Jun 09 21:52:58.681571 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:52:58.681542 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2fa1cd_827c_4df6_abe6_72a316c32c3d.slice/crio-10c9bb8809e2983c9af42a3d94686aa920b676cd747cd312cef7ffb66c2fcd41 WatchSource:0}: Error finding container 10c9bb8809e2983c9af42a3d94686aa920b676cd747cd312cef7ffb66c2fcd41: Status 404 returned error can't find the container with id 10c9bb8809e2983c9af42a3d94686aa920b676cd747cd312cef7ffb66c2fcd41 Jun 09 21:52:59.167935 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:52:59.167897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" event={"ID":"2d2fa1cd-827c-4df6-abe6-72a316c32c3d","Type":"ContainerStarted","Data":"10c9bb8809e2983c9af42a3d94686aa920b676cd747cd312cef7ffb66c2fcd41"} Jun 09 21:53:00.176679 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:00.176628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" event={"ID":"28997144-f467-4e52-bd57-05f248283752","Type":"ContainerStarted","Data":"0a2d184391111741013f2e38d82cf92b19c45970517ca1a7d6b0d58dd2a5e51c"} Jun 09 21:53:00.177089 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:00.176821 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:53:00.193214 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:00.193148 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" podStartSLOduration=2.24053209 podStartE2EDuration="5.193128902s" totalImagesPullingTime="2.952596812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:00.19151232 +0000 UTC m=+468.158981162" watchObservedRunningTime="2026-06-09 21:53:00.193128902 +0000 UTC m=+468.160597741" Jun 09 21:53:02.187486 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:02.187448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" event={"ID":"2d2fa1cd-827c-4df6-abe6-72a316c32c3d","Type":"ContainerStarted","Data":"023da8aa57f0c8e64c8eaeef53d8037657772773d8aee359ef52739c4b9316bb"} Jun 09 21:53:03.192499 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:03.192458 2579 generic.go:356] "Generic (PLEG): container finished" podID="2d2fa1cd-827c-4df6-abe6-72a316c32c3d" containerID="023da8aa57f0c8e64c8eaeef53d8037657772773d8aee359ef52739c4b9316bb" exitCode=0 Jun 09 21:53:03.192913 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:03.192569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" event={"ID":"2d2fa1cd-827c-4df6-abe6-72a316c32c3d","Type":"ContainerDied","Data":"023da8aa57f0c8e64c8eaeef53d8037657772773d8aee359ef52739c4b9316bb"} Jun 09 21:53:04.198682 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:04.198618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" event={"ID":"2d2fa1cd-827c-4df6-abe6-72a316c32c3d","Type":"ContainerStarted","Data":"cb4403b9f1ec6d9666b1f69866f2adbc7eb7a740a083dd87ef36fa91207c5488"} Jun 09 21:53:04.199136 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:04.198710 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:53:04.218835 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:04.218783 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" podStartSLOduration=3.045811345 podStartE2EDuration="7.218767221s" totalImagesPullingTime="3.266439569s" totalInitContainerRuntime="906.516307ms" isStatefulPod=false podCreationTimestamp="2026-06-09 21:52:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:04.218153088 +0000 UTC m=+472.185621935" watchObservedRunningTime="2026-06-09 21:53:04.218767221 +0000 UTC m=+472.186236060" Jun 09 21:53:11.183582 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:11.183551 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9d96bd75-rj9m6" Jun 09 21:53:15.205289 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:15.205259 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-rf9w8" Jun 09 21:53:17.472090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.472053 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6"] Jun 09 21:53:17.559879 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.559846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6"] Jun 09 21:53:17.560070 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.559970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.562542 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.562518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 21:53:17.562704 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.562602 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 21:53:17.562704 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.562678 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kzkmp\"" Jun 09 21:53:17.591222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.591191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9s5\" (UniqueName: \"kubernetes.io/projected/3c274e88-dd74-4286-b0cf-ecc820085234-kube-api-access-cn9s5\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.591383 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.591240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c274e88-dd74-4286-b0cf-ecc820085234-tmp\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.591383 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.591299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c274e88-dd74-4286-b0cf-ecc820085234-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.692741 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.692700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9s5\" (UniqueName: \"kubernetes.io/projected/3c274e88-dd74-4286-b0cf-ecc820085234-kube-api-access-cn9s5\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.692927 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.692762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c274e88-dd74-4286-b0cf-ecc820085234-tmp\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.692927 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.692793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c274e88-dd74-4286-b0cf-ecc820085234-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.695111 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.695085 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c274e88-dd74-4286-b0cf-ecc820085234-tmp\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.695496 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.695467 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c274e88-dd74-4286-b0cf-ecc820085234-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.715264 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.715236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9s5\" (UniqueName: \"kubernetes.io/projected/3c274e88-dd74-4286-b0cf-ecc820085234-kube-api-access-cn9s5\") pod \"kube-auth-proxy-6d56bf64cc-l2st6\" (UID: \"3c274e88-dd74-4286-b0cf-ecc820085234\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:17.869995 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:17.869967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" Jun 09 21:53:18.032253 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:18.032226 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6"] Jun 09 21:53:18.035095 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:53:18.035066 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c274e88_dd74_4286_b0cf_ecc820085234.slice/crio-c22ddac4613d937eb7217fd7670c5ccff9a25158cd298d76aabab4daf9044535 WatchSource:0}: Error finding container c22ddac4613d937eb7217fd7670c5ccff9a25158cd298d76aabab4daf9044535: Status 404 returned error can't find the container with id c22ddac4613d937eb7217fd7670c5ccff9a25158cd298d76aabab4daf9044535 Jun 09 21:53:18.259141 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:18.259063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" event={"ID":"3c274e88-dd74-4286-b0cf-ecc820085234","Type":"ContainerStarted","Data":"c22ddac4613d937eb7217fd7670c5ccff9a25158cd298d76aabab4daf9044535"} Jun 09 21:53:22.281016 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:22.280981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" event={"ID":"3c274e88-dd74-4286-b0cf-ecc820085234","Type":"ContainerStarted","Data":"f9238de766f1ab903f1426b47a39ca772f67f67ba1eb68be29e55c9ee18d2fbf"} Jun 09 21:53:22.297688 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:53:22.297612 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-l2st6" podStartSLOduration=2.024473106 podStartE2EDuration="5.29759616s" totalImagesPullingTime="3.273123054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:22.296420798 +0000 UTC m=+490.263889639" watchObservedRunningTime="2026-06-09 21:53:22.29759616 +0000 UTC m=+490.265065000" Jun 09 21:55:02.045201 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.045158 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm"] Jun 09 21:55:02.048679 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.048633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:02.051095 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.051072 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 21:55:02.051291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.051110 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 21:55:02.051291 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.051157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 21:55:02.052090 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.052074 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9gjhj\"" Jun 09 21:55:02.057878 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.057852 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm"] Jun 09 21:55:02.203898 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.203861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8gwz\" (UniqueName: \"kubernetes.io/projected/b00ccbff-bfef-41e8-adff-034864baa42e-kube-api-access-p8gwz\") pod \"dns-operator-controller-manager-864dd78c4c-7rdmm\" (UID: \"b00ccbff-bfef-41e8-adff-034864baa42e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:02.305186 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.305089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8gwz\" (UniqueName: \"kubernetes.io/projected/b00ccbff-bfef-41e8-adff-034864baa42e-kube-api-access-p8gwz\") pod \"dns-operator-controller-manager-864dd78c4c-7rdmm\" (UID: \"b00ccbff-bfef-41e8-adff-034864baa42e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:02.313063 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.313018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8gwz\" (UniqueName: \"kubernetes.io/projected/b00ccbff-bfef-41e8-adff-034864baa42e-kube-api-access-p8gwz\") pod \"dns-operator-controller-manager-864dd78c4c-7rdmm\" (UID: \"b00ccbff-bfef-41e8-adff-034864baa42e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:02.359131 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.359095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:02.503032 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.502972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm"] Jun 09 21:55:02.704795 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:02.704760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" event={"ID":"b00ccbff-bfef-41e8-adff-034864baa42e","Type":"ContainerStarted","Data":"4af208c37bc9882bd9d7cc9363e54cb4b0438407c71c41a072117c2303580b0b"} Jun 09 21:55:05.721596 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:05.721559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" event={"ID":"b00ccbff-bfef-41e8-adff-034864baa42e","Type":"ContainerStarted","Data":"931ff7b89589020859f9f5eb27ed49e8210b8dec356d9f561b60aabb358ef163"} Jun 09 21:55:05.721986 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:05.721691 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:05.738239 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:05.738182 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" podStartSLOduration=1.173979644 podStartE2EDuration="3.738165923s" totalImagesPullingTime="2.564186279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:55:05.73686187 +0000 UTC m=+593.704330712" watchObservedRunningTime="2026-06-09 21:55:05.738165923 +0000 UTC m=+593.705634763" Jun 09 21:55:12.478045 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:12.478017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:55:12.478485 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:12.478464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 21:55:12.486925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:12.486901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:55:12.487547 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:12.487523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 21:55:15.917342 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:15.917303 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp"] Jun 09 21:55:15.920427 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:15.920411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:15.923200 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:15.923167 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h86d7\"" Jun 09 21:55:15.935786 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:15.935757 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp"] Jun 09 21:55:16.031729 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.031696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.031729 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.031739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbqs2\" (UniqueName: \"kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.075522 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.075488 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp"] Jun 09 21:55:16.075787 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:55:16.075768 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bbqs2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" podUID="cb76184c-f044-49fa-bda6-6b9c6f60ba2e" Jun 09 21:55:16.133060 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.133025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.133060 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.133065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbqs2\" (UniqueName: \"kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.133438 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.133417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.143440 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.143416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbqs2\" (UniqueName: \"kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.452956 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.452920 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp"] Jun 09 21:55:16.460475 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.460448 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp"] Jun 09 21:55:16.498871 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.498839 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:16.502154 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.502133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.516844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.516817 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:16.638432 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.638397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.638597 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.638460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqcx8\" (UniqueName: \"kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.727927 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.727839 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rdmm" Jun 09 21:55:16.739110 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.739082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqcx8\" (UniqueName: \"kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.739248 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.739167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.739527 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.739509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.748735 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.748709 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqcx8\" (UniqueName: \"kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgxsn\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.773878 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.773852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.781263 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.781238 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.783824 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:55:16.783798 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="cb76184c-f044-49fa-bda6-6b9c6f60ba2e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:16.814371 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.814342 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:16.942048 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.941989 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbqs2\" (UniqueName: \"kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2\") pod \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " Jun 09 21:55:16.945150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.942059 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume\") pod \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\" (UID: \"cb76184c-f044-49fa-bda6-6b9c6f60ba2e\") " Jun 09 21:55:16.945150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.944628 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb76184c-f044-49fa-bda6-6b9c6f60ba2e" (UID: "cb76184c-f044-49fa-bda6-6b9c6f60ba2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:55:16.945150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.944755 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2" (OuterVolumeSpecName: "kube-api-access-bbqs2") pod "cb76184c-f044-49fa-bda6-6b9c6f60ba2e" (UID: "cb76184c-f044-49fa-bda6-6b9c6f60ba2e"). InnerVolumeSpecName "kube-api-access-bbqs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:55:16.954392 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:16.954350 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:16.958064 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:55:16.958040 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34cbef5_b651_443f_8982_7eb68f1f4ea3.slice/crio-bbce3e0e3a411e3186a8188610bb4ec393352bd5d1bbb85bfeea54beda459742 WatchSource:0}: Error finding container bbce3e0e3a411e3186a8188610bb4ec393352bd5d1bbb85bfeea54beda459742: Status 404 returned error can't find the container with id bbce3e0e3a411e3186a8188610bb4ec393352bd5d1bbb85bfeea54beda459742 Jun 09 21:55:17.045348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:17.045272 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbqs2\" (UniqueName: \"kubernetes.io/projected/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-kube-api-access-bbqs2\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:55:17.045348 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:17.045302 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb76184c-f044-49fa-bda6-6b9c6f60ba2e-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:55:17.778845 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:17.778810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" event={"ID":"f34cbef5-b651-443f-8982-7eb68f1f4ea3","Type":"ContainerStarted","Data":"bbce3e0e3a411e3186a8188610bb4ec393352bd5d1bbb85bfeea54beda459742"} Jun 09 21:55:17.778845 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:17.778837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:17.781168 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:55:17.781143 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="cb76184c-f044-49fa-bda6-6b9c6f60ba2e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:17.788374 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:55:17.788341 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rkpbp\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="cb76184c-f044-49fa-bda6-6b9c6f60ba2e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkpbp" Jun 09 21:55:18.514503 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:18.514467 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb76184c-f044-49fa-bda6-6b9c6f60ba2e" path="/var/lib/kubelet/pods/cb76184c-f044-49fa-bda6-6b9c6f60ba2e/volumes" Jun 09 21:55:21.804103 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:21.804067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" event={"ID":"f34cbef5-b651-443f-8982-7eb68f1f4ea3","Type":"ContainerStarted","Data":"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b"} Jun 09 21:55:21.804556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:21.804206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:21.827057 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:21.827009 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" podStartSLOduration=1.102921413 podStartE2EDuration="5.826993332s" totalImagesPullingTime="4.724071919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:55:21.824114832 +0000 UTC m=+609.791583672" watchObservedRunningTime="2026-06-09 21:55:21.826993332 +0000 UTC m=+609.794462172" Jun 09 21:55:28.909409 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:28.909372 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:28.909843 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:28.909558 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" podUID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" containerName="manager" containerID="cri-o://56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b" gracePeriod=10 Jun 09 21:55:28.911488 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:28.911463 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:29.157171 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.157147 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:29.200154 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.200084 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 21:55:29.200400 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.200389 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" containerName="manager" Jun 09 21:55:29.200447 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.200402 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" containerName="manager" Jun 09 21:55:29.200480 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.200469 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" containerName="manager" Jun 09 21:55:29.203352 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.203336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.216843 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.216817 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 21:55:29.256910 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.256876 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume\") pod \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " Jun 09 21:55:29.257079 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.256932 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqcx8\" (UniqueName: \"kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8\") pod \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\" (UID: \"f34cbef5-b651-443f-8982-7eb68f1f4ea3\") " Jun 09 21:55:29.257131 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.257108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jps9z\" (UniqueName: \"kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.257172 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.257144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.257378 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.257354 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f34cbef5-b651-443f-8982-7eb68f1f4ea3" (UID: "f34cbef5-b651-443f-8982-7eb68f1f4ea3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:55:29.259333 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.259309 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8" (OuterVolumeSpecName: "kube-api-access-cqcx8") pod "f34cbef5-b651-443f-8982-7eb68f1f4ea3" (UID: "f34cbef5-b651-443f-8982-7eb68f1f4ea3"). InnerVolumeSpecName "kube-api-access-cqcx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:55:29.358334 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.358284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jps9z\" (UniqueName: \"kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.358334 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.358327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.358556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.358403 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqcx8\" (UniqueName: \"kubernetes.io/projected/f34cbef5-b651-443f-8982-7eb68f1f4ea3-kube-api-access-cqcx8\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:55:29.358556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.358416 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34cbef5-b651-443f-8982-7eb68f1f4ea3-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:55:29.358883 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.358860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.367196 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.367166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jps9z\" (UniqueName: \"kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z\") pod \"kuadrant-operator-controller-manager-86878c769f-xfn6x\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.513672 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.513549 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.648382 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.648315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 21:55:29.650995 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:55:29.650966 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245dcc2b_9834_47a8_b086_1dd8f51a3749.slice/crio-2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7 WatchSource:0}: Error finding container 2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7: Status 404 returned error can't find the container with id 2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7 Jun 09 21:55:29.842170 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.842067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" event={"ID":"245dcc2b-9834-47a8-b086-1dd8f51a3749","Type":"ContainerStarted","Data":"9fabb3c19bb4ac06010eb0c19e6dfca8f6e1c8029b37825d774b92720e49ef97"} Jun 09 21:55:29.842170 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.842123 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:55:29.842170 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.842150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" event={"ID":"245dcc2b-9834-47a8-b086-1dd8f51a3749","Type":"ContainerStarted","Data":"2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7"} Jun 09 21:55:29.843387 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.843361 2579 generic.go:356] "Generic (PLEG): container finished" podID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" containerID="56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b" exitCode=0 Jun 09 21:55:29.843513 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.843403 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" Jun 09 21:55:29.843513 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.843428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" event={"ID":"f34cbef5-b651-443f-8982-7eb68f1f4ea3","Type":"ContainerDied","Data":"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b"} Jun 09 21:55:29.843513 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.843465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn" event={"ID":"f34cbef5-b651-443f-8982-7eb68f1f4ea3","Type":"ContainerDied","Data":"bbce3e0e3a411e3186a8188610bb4ec393352bd5d1bbb85bfeea54beda459742"} Jun 09 21:55:29.843513 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.843490 2579 scope.go:117] "RemoveContainer" containerID="56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b" Jun 09 21:55:29.852248 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.852227 2579 scope.go:117] "RemoveContainer" containerID="56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b" Jun 09 21:55:29.852492 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:55:29.852474 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b\": container with ID starting with 56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b not found: ID does not exist" containerID="56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b" Jun 09 21:55:29.852537 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.852501 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b"} err="failed to get container status \"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b\": rpc error: code = NotFound desc = could not find container \"56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b\": container with ID starting with 56464e89ebe0f76581ddf4734ef127ad91d20b7f0223957f67ab12bf0e55c02b not found: ID does not exist" Jun 09 21:55:29.864420 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.864375 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" podStartSLOduration=0.864359148 podStartE2EDuration="864.359148ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:55:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:55:29.863224795 +0000 UTC m=+617.830693632" watchObservedRunningTime="2026-06-09 21:55:29.864359148 +0000 UTC m=+617.831827990" Jun 09 21:55:29.876756 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.876731 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:29.879961 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:29.879941 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgxsn"] Jun 09 21:55:30.513845 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:30.513809 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34cbef5-b651-443f-8982-7eb68f1f4ea3" path="/var/lib/kubelet/pods/f34cbef5-b651-443f-8982-7eb68f1f4ea3/volumes" Jun 09 21:55:40.851363 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:55:40.851333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 21:56:03.405833 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.405793 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:03.409316 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.409292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:03.411580 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.411561 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xhwjh\"" Jun 09 21:56:03.419210 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.419185 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:03.460760 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.460722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28sl\" (UniqueName: \"kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl\") pod \"authorino-58cd955675-lc59w\" (UID: \"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3\") " pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:03.561929 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.561890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28sl\" (UniqueName: \"kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl\") pod \"authorino-58cd955675-lc59w\" (UID: \"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3\") " pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:03.570143 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.570109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28sl\" (UniqueName: \"kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl\") pod \"authorino-58cd955675-lc59w\" (UID: \"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3\") " pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:03.582010 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.581981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:56:03.585356 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.585331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:56:03.590808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.590784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:56:03.662686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.662582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86dp\" (UniqueName: \"kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp\") pod \"authorino-75d556bd77-6h66r\" (UID: \"b55c4de3-6e0c-40dc-9df9-7b86235ae074\") " pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:56:03.720544 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.720496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:03.763957 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.763923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86dp\" (UniqueName: \"kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp\") pod \"authorino-75d556bd77-6h66r\" (UID: \"b55c4de3-6e0c-40dc-9df9-7b86235ae074\") " pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:56:03.772485 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.772450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86dp\" (UniqueName: \"kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp\") pod \"authorino-75d556bd77-6h66r\" (UID: \"b55c4de3-6e0c-40dc-9df9-7b86235ae074\") " pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:56:03.851553 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.851527 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:03.853886 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:56:03.853860 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0fe6b74_2eaa_43e7_be2c_1c59cc11c9f3.slice/crio-22fef75c59788f51c2233ed753a2333c118bd2bc4bf92e5ffcde51d0c23fc6ec WatchSource:0}: Error finding container 22fef75c59788f51c2233ed753a2333c118bd2bc4bf92e5ffcde51d0c23fc6ec: Status 404 returned error can't find the container with id 22fef75c59788f51c2233ed753a2333c118bd2bc4bf92e5ffcde51d0c23fc6ec Jun 09 21:56:03.895552 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:03.895515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:56:04.004925 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:04.004891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lc59w" event={"ID":"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3","Type":"ContainerStarted","Data":"22fef75c59788f51c2233ed753a2333c118bd2bc4bf92e5ffcde51d0c23fc6ec"} Jun 09 21:56:04.028535 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:04.028510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:56:04.030612 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:56:04.030576 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb55c4de3_6e0c_40dc_9df9_7b86235ae074.slice/crio-a3a53175d44af358dfe586a08d94a6d964b9546a9dc483012201493495751c20 WatchSource:0}: Error finding container a3a53175d44af358dfe586a08d94a6d964b9546a9dc483012201493495751c20: Status 404 returned error can't find the container with id a3a53175d44af358dfe586a08d94a6d964b9546a9dc483012201493495751c20 Jun 09 21:56:05.018984 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:05.018937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6h66r" event={"ID":"b55c4de3-6e0c-40dc-9df9-7b86235ae074","Type":"ContainerStarted","Data":"a3a53175d44af358dfe586a08d94a6d964b9546a9dc483012201493495751c20"} Jun 09 21:56:08.037800 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:08.037759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6h66r" event={"ID":"b55c4de3-6e0c-40dc-9df9-7b86235ae074","Type":"ContainerStarted","Data":"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45"} Jun 09 21:56:08.039234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:08.039207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lc59w" event={"ID":"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3","Type":"ContainerStarted","Data":"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e"} Jun 09 21:56:08.050926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:08.050880 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6h66r" podStartSLOduration=1.687917404 podStartE2EDuration="5.050864992s" totalImagesPullingTime="3.362947588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:08.050575665 +0000 UTC m=+656.018044507" watchObservedRunningTime="2026-06-09 21:56:08.050864992 +0000 UTC m=+656.018333832" Jun 09 21:56:08.062853 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:08.062805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lc59w" podStartSLOduration=1.511312798 podStartE2EDuration="5.062788946s" totalImagesPullingTime="3.551476148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:08.062245162 +0000 UTC m=+656.029714003" watchObservedRunningTime="2026-06-09 21:56:08.062788946 +0000 UTC m=+656.030257814" Jun 09 21:56:08.087606 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:08.087569 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:10.048158 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:10.048115 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lc59w" podUID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" containerName="authorino" containerID="cri-o://0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e" gracePeriod=30 Jun 09 21:56:10.302966 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:10.302892 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:10.324961 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:10.324907 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q28sl\" (UniqueName: \"kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl\") pod \"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3\" (UID: \"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3\") " Jun 09 21:56:10.327155 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:10.327131 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl" (OuterVolumeSpecName: "kube-api-access-q28sl") pod "f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" (UID: "f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3"). InnerVolumeSpecName "kube-api-access-q28sl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:56:10.425973 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:10.425928 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q28sl\" (UniqueName: \"kubernetes.io/projected/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3-kube-api-access-q28sl\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:56:11.053812 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.053772 2579 generic.go:356] "Generic (PLEG): container finished" podID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" containerID="0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e" exitCode=0 Jun 09 21:56:11.053812 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.053815 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lc59w" Jun 09 21:56:11.054338 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.053860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lc59w" event={"ID":"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3","Type":"ContainerDied","Data":"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e"} Jun 09 21:56:11.054338 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.053903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lc59w" event={"ID":"f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3","Type":"ContainerDied","Data":"22fef75c59788f51c2233ed753a2333c118bd2bc4bf92e5ffcde51d0c23fc6ec"} Jun 09 21:56:11.054338 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.053922 2579 scope.go:117] "RemoveContainer" containerID="0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e" Jun 09 21:56:11.062293 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.062276 2579 scope.go:117] "RemoveContainer" containerID="0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e" Jun 09 21:56:11.062552 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:56:11.062529 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e\": container with ID starting with 0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e not found: ID does not exist" containerID="0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e" Jun 09 21:56:11.062622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.062564 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e"} err="failed to get container status \"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e\": rpc error: code = NotFound desc = could not find container \"0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e\": container with ID starting with 0c65c7bcd282ce6e56ae78c1b65aceb1f85aafcddd46b1203ffc773a99aee31e not found: ID does not exist" Jun 09 21:56:11.069399 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.069376 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:11.072786 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:11.072766 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lc59w"] Jun 09 21:56:12.513292 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:12.513264 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" path="/var/lib/kubelet/pods/f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3/volumes" Jun 09 21:56:58.935982 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.935941 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:56:58.936556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.936438 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" containerName="authorino" Jun 09 21:56:58.936556 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.936458 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" containerName="authorino" Jun 09 21:56:58.936771 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.936560 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0fe6b74-2eaa-43e7-be2c-1c59cc11c9f3" containerName="authorino" Jun 09 21:56:58.939514 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.939492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:56:58.942107 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.942089 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 21:56:58.942200 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.942123 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 21:56:58.942945 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.942928 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 21:56:58.943001 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.942928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sxqcx\"" Jun 09 21:56:58.949748 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:58.949727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:56:59.053544 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:59.053502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72gv\" (UniqueName: \"kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv\") pod \"maas-keycloak-0\" (UID: \"619bef53-b2d7-4225-90b6-e241415d2ccd\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:56:59.154899 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:59.154860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72gv\" (UniqueName: \"kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv\") pod \"maas-keycloak-0\" (UID: \"619bef53-b2d7-4225-90b6-e241415d2ccd\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:56:59.164121 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:59.164096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72gv\" (UniqueName: \"kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv\") pod \"maas-keycloak-0\" (UID: \"619bef53-b2d7-4225-90b6-e241415d2ccd\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:56:59.249818 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:59.249726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:56:59.383396 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:56:59.383370 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:56:59.386082 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:56:59.386056 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619bef53_b2d7_4225_90b6_e241415d2ccd.slice/crio-3b636dc16409bbf19c09fbc28e2fcfc2aed91fd976f556fc5aacdcfd8c72f12d WatchSource:0}: Error finding container 3b636dc16409bbf19c09fbc28e2fcfc2aed91fd976f556fc5aacdcfd8c72f12d: Status 404 returned error can't find the container with id 3b636dc16409bbf19c09fbc28e2fcfc2aed91fd976f556fc5aacdcfd8c72f12d Jun 09 21:57:00.282140 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:00.282101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"619bef53-b2d7-4225-90b6-e241415d2ccd","Type":"ContainerStarted","Data":"3b636dc16409bbf19c09fbc28e2fcfc2aed91fd976f556fc5aacdcfd8c72f12d"} Jun 09 21:57:05.318395 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:05.318281 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"619bef53-b2d7-4225-90b6-e241415d2ccd","Type":"ContainerStarted","Data":"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611"} Jun 09 21:57:05.335733 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:05.335677 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.840002552 podStartE2EDuration="7.3356575s" totalImagesPullingTime="5.495654948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:57:05.334250437 +0000 UTC m=+713.301719279" watchObservedRunningTime="2026-06-09 21:57:05.3356575 +0000 UTC m=+713.303126333" Jun 09 21:57:06.250569 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:06.250519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 21:57:06.252504 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:06.252458 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:07.250867 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:07.250809 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:08.250431 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:08.250377 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:09.250631 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:09.250569 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 21:57:09.251835 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:09.251798 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:10.250722 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:10.250673 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:11.251180 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:11.251125 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:12.250570 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:12.250520 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:13.250234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:13.250185 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:14.250933 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:14.250890 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:15.250536 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:15.250484 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:16.251139 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:16.251070 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:17.250203 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:17.250158 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 09 21:57:18.338107 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:18.338065 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 21:57:18.357573 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:18.357509 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:57:28.345163 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:28.345129 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 21:57:29.195500 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.195464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:29.201786 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.201768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:29.204897 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.204867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:29.250331 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.250287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggvh\" (UniqueName: \"kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh\") pod \"authorino-5d4b67c446-b6jtl\" (UID: \"b706dedb-896e-4519-a0c6-85e7ba8d3817\") " pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:29.351202 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.351162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggvh\" (UniqueName: \"kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh\") pod \"authorino-5d4b67c446-b6jtl\" (UID: \"b706dedb-896e-4519-a0c6-85e7ba8d3817\") " pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:29.359966 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.359939 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggvh\" (UniqueName: \"kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh\") pod \"authorino-5d4b67c446-b6jtl\" (UID: \"b706dedb-896e-4519-a0c6-85e7ba8d3817\") " pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:29.413753 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.413718 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:29.414030 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.414013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:29.435832 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.435805 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c9f774ccd-nr5vx"] Jun 09 21:57:29.438277 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.438260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:29.445893 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.445826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c9f774ccd-nr5vx"] Jun 09 21:57:29.452021 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.451995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj56x\" (UniqueName: \"kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x\") pod \"authorino-6c9f774ccd-nr5vx\" (UID: \"8beba20f-090c-4554-9257-7ca36abb4806\") " pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:29.497928 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.497896 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c9f774ccd-nr5vx"] Jun 09 21:57:29.498259 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:57:29.498232 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hj56x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" podUID="8beba20f-090c-4554-9257-7ca36abb4806" Jun 09 21:57:29.522097 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.521776 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:57:29.524846 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.524825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.527176 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.527154 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 21:57:29.531691 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.531661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:57:29.551616 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.551593 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:29.553244 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.553177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.553446 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.553427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj56x\" (UniqueName: \"kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x\") pod \"authorino-6c9f774ccd-nr5vx\" (UID: \"8beba20f-090c-4554-9257-7ca36abb4806\") " pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:29.553693 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.553584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vww\" (UniqueName: \"kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.554190 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:57:29.554169 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb706dedb_896e_4519_a0c6_85e7ba8d3817.slice/crio-7af6cddd70dd20f75347ab281fd11ed05a37f7529ac07c3546387dc7a0d18dda WatchSource:0}: Error finding container 7af6cddd70dd20f75347ab281fd11ed05a37f7529ac07c3546387dc7a0d18dda: Status 404 returned error can't find the container with id 7af6cddd70dd20f75347ab281fd11ed05a37f7529ac07c3546387dc7a0d18dda Jun 09 21:57:29.561911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.561892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj56x\" (UniqueName: \"kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x\") pod \"authorino-6c9f774ccd-nr5vx\" (UID: \"8beba20f-090c-4554-9257-7ca36abb4806\") " pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:29.654902 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.654872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vww\" (UniqueName: \"kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.655077 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.654930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.657539 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.657517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.661910 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.661886 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vww\" (UniqueName: \"kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww\") pod \"authorino-7cddb9cd98-k8t28\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.836281 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.836188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:57:29.972546 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:29.972524 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:57:29.974187 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:57:29.974162 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31d8ee69_4a8a_488f_88c5_c46623d97047.slice/crio-aa17a1b3e394a56605174e64ea98406914072db4721cdf9ebbbdf0549ba6ade4 WatchSource:0}: Error finding container aa17a1b3e394a56605174e64ea98406914072db4721cdf9ebbbdf0549ba6ade4: Status 404 returned error can't find the container with id aa17a1b3e394a56605174e64ea98406914072db4721cdf9ebbbdf0549ba6ade4 Jun 09 21:57:30.484931 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.484894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" event={"ID":"31d8ee69-4a8a-488f-88c5-c46623d97047","Type":"ContainerStarted","Data":"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a"} Jun 09 21:57:30.485386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.484950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" event={"ID":"31d8ee69-4a8a-488f-88c5-c46623d97047","Type":"ContainerStarted","Data":"aa17a1b3e394a56605174e64ea98406914072db4721cdf9ebbbdf0549ba6ade4"} Jun 09 21:57:30.487212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.487182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" event={"ID":"b706dedb-896e-4519-a0c6-85e7ba8d3817","Type":"ContainerStarted","Data":"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c"} Jun 09 21:57:30.487212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.487203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:30.487212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.487204 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" podUID="b706dedb-896e-4519-a0c6-85e7ba8d3817" containerName="authorino" containerID="cri-o://d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c" gracePeriod=30 Jun 09 21:57:30.487461 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.487224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" event={"ID":"b706dedb-896e-4519-a0c6-85e7ba8d3817","Type":"ContainerStarted","Data":"7af6cddd70dd20f75347ab281fd11ed05a37f7529ac07c3546387dc7a0d18dda"} Jun 09 21:57:30.494285 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.494260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:30.499955 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.499911 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" podStartSLOduration=1.118624102 podStartE2EDuration="1.49989553s" totalImagesPullingTime="381.271428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:57:30.498235198 +0000 UTC m=+738.465704039" watchObservedRunningTime="2026-06-09 21:57:30.49989553 +0000 UTC m=+738.467364371" Jun 09 21:57:30.520026 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.519976 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" podStartSLOduration=1.152746752 podStartE2EDuration="1.519957127s" totalImagesPullingTime="367.210375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:57:30.518174505 +0000 UTC m=+738.485643345" watchObservedRunningTime="2026-06-09 21:57:30.519957127 +0000 UTC m=+738.487425970" Jun 09 21:57:30.542756 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.542731 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:57:30.542944 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.542922 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6h66r" podUID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" containerName="authorino" containerID="cri-o://e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45" gracePeriod=30 Jun 09 21:57:30.560521 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.560494 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj56x\" (UniqueName: \"kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x\") pod \"8beba20f-090c-4554-9257-7ca36abb4806\" (UID: \"8beba20f-090c-4554-9257-7ca36abb4806\") " Jun 09 21:57:30.562607 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.562574 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x" (OuterVolumeSpecName: "kube-api-access-hj56x") pod "8beba20f-090c-4554-9257-7ca36abb4806" (UID: "8beba20f-090c-4554-9257-7ca36abb4806"). InnerVolumeSpecName "kube-api-access-hj56x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:57:30.661451 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.661410 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj56x\" (UniqueName: \"kubernetes.io/projected/8beba20f-090c-4554-9257-7ca36abb4806-kube-api-access-hj56x\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:57:30.805385 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.805359 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:30.812553 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.812518 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:57:30.862997 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.862964 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h86dp\" (UniqueName: \"kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp\") pod \"b55c4de3-6e0c-40dc-9df9-7b86235ae074\" (UID: \"b55c4de3-6e0c-40dc-9df9-7b86235ae074\") " Jun 09 21:57:30.863150 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.863021 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ggvh\" (UniqueName: \"kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh\") pod \"b706dedb-896e-4519-a0c6-85e7ba8d3817\" (UID: \"b706dedb-896e-4519-a0c6-85e7ba8d3817\") " Jun 09 21:57:30.865211 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.865186 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp" (OuterVolumeSpecName: "kube-api-access-h86dp") pod "b55c4de3-6e0c-40dc-9df9-7b86235ae074" (UID: "b55c4de3-6e0c-40dc-9df9-7b86235ae074"). InnerVolumeSpecName "kube-api-access-h86dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:57:30.865351 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.865329 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh" (OuterVolumeSpecName: "kube-api-access-4ggvh") pod "b706dedb-896e-4519-a0c6-85e7ba8d3817" (UID: "b706dedb-896e-4519-a0c6-85e7ba8d3817"). InnerVolumeSpecName "kube-api-access-4ggvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:57:30.963905 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.963819 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ggvh\" (UniqueName: \"kubernetes.io/projected/b706dedb-896e-4519-a0c6-85e7ba8d3817-kube-api-access-4ggvh\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:57:30.963905 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:30.963850 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h86dp\" (UniqueName: \"kubernetes.io/projected/b55c4de3-6e0c-40dc-9df9-7b86235ae074-kube-api-access-h86dp\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:57:31.493257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.493218 2579 generic.go:356] "Generic (PLEG): container finished" podID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" containerID="e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45" exitCode=0 Jun 09 21:57:31.493257 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.493257 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6h66r" Jun 09 21:57:31.493760 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.493299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6h66r" event={"ID":"b55c4de3-6e0c-40dc-9df9-7b86235ae074","Type":"ContainerDied","Data":"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45"} Jun 09 21:57:31.493760 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.493342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6h66r" event={"ID":"b55c4de3-6e0c-40dc-9df9-7b86235ae074","Type":"ContainerDied","Data":"a3a53175d44af358dfe586a08d94a6d964b9546a9dc483012201493495751c20"} Jun 09 21:57:31.493760 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.493366 2579 scope.go:117] "RemoveContainer" containerID="e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45" Jun 09 21:57:31.494820 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.494681 2579 generic.go:356] "Generic (PLEG): container finished" podID="b706dedb-896e-4519-a0c6-85e7ba8d3817" containerID="d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c" exitCode=0 Jun 09 21:57:31.494820 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.494757 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" Jun 09 21:57:31.494820 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.494770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" event={"ID":"b706dedb-896e-4519-a0c6-85e7ba8d3817","Type":"ContainerDied","Data":"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c"} Jun 09 21:57:31.494820 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.494801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b6jtl" event={"ID":"b706dedb-896e-4519-a0c6-85e7ba8d3817","Type":"ContainerDied","Data":"7af6cddd70dd20f75347ab281fd11ed05a37f7529ac07c3546387dc7a0d18dda"} Jun 09 21:57:31.495029 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.494887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9f774ccd-nr5vx" Jun 09 21:57:31.503620 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.503602 2579 scope.go:117] "RemoveContainer" containerID="e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45" Jun 09 21:57:31.503977 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:57:31.503949 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45\": container with ID starting with e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45 not found: ID does not exist" containerID="e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45" Jun 09 21:57:31.504083 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.503991 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45"} err="failed to get container status \"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45\": rpc error: code = NotFound desc = could not find container \"e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45\": container with ID starting with e0054926f01de6f4b5c84b3d5d5e94b0d90e088fdfea50feb73a317661cb9c45 not found: ID does not exist" Jun 09 21:57:31.504083 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.504016 2579 scope.go:117] "RemoveContainer" containerID="d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c" Jun 09 21:57:31.512074 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.512057 2579 scope.go:117] "RemoveContainer" containerID="d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c" Jun 09 21:57:31.512314 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:57:31.512294 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c\": container with ID starting with d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c not found: ID does not exist" containerID="d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c" Jun 09 21:57:31.512364 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.512321 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c"} err="failed to get container status \"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c\": rpc error: code = NotFound desc = could not find container \"d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c\": container with ID starting with d9e0324d0d2d98d6b9463d15fd704d92ab993529def715ee04676af70185aa1c not found: ID does not exist" Jun 09 21:57:31.527563 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.527540 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c9f774ccd-nr5vx"] Jun 09 21:57:31.532063 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.532040 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c9f774ccd-nr5vx"] Jun 09 21:57:31.540174 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.540150 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:57:31.543793 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.543763 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6h66r"] Jun 09 21:57:31.557545 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.557521 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:31.561137 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:31.561119 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b6jtl"] Jun 09 21:57:32.513749 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:32.513718 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8beba20f-090c-4554-9257-7ca36abb4806" path="/var/lib/kubelet/pods/8beba20f-090c-4554-9257-7ca36abb4806/volumes" Jun 09 21:57:32.514121 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:32.513949 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" path="/var/lib/kubelet/pods/b55c4de3-6e0c-40dc-9df9-7b86235ae074/volumes" Jun 09 21:57:32.514229 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:32.514217 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b706dedb-896e-4519-a0c6-85e7ba8d3817" path="/var/lib/kubelet/pods/b706dedb-896e-4519-a0c6-85e7ba8d3817/volumes" Jun 09 21:57:33.957329 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957294 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:33.957783 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957751 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" containerName="authorino" Jun 09 21:57:33.957783 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957770 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" containerName="authorino" Jun 09 21:57:33.957911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957792 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b706dedb-896e-4519-a0c6-85e7ba8d3817" containerName="authorino" Jun 09 21:57:33.957911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957801 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b706dedb-896e-4519-a0c6-85e7ba8d3817" containerName="authorino" Jun 09 21:57:33.957911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957893 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b706dedb-896e-4519-a0c6-85e7ba8d3817" containerName="authorino" Jun 09 21:57:33.957911 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.957908 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b55c4de3-6e0c-40dc-9df9-7b86235ae074" containerName="authorino" Jun 09 21:57:33.960757 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.960738 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:33.963721 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.963693 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 21:57:33.964766 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.964747 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 21:57:33.964825 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.964812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w6mdz\"" Jun 09 21:57:33.971243 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.971216 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:33.984555 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.984522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz78j\" (UniqueName: \"kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:33.984691 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:33.984614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.085159 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.085116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.085316 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.085201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz78j\" (UniqueName: \"kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.087781 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.087756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.093340 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.093316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz78j\" (UniqueName: \"kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j\") pod \"maas-controller-78986f5cb6-74xjx\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.113980 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.113952 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 21:57:34.116202 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.116186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.124730 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.124709 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 21:57:34.185663 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.185617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.185868 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.185684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czhrh\" (UniqueName: \"kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.272555 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.272461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:34.286798 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.286769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhrh\" (UniqueName: \"kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.286937 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.286897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.289469 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.289445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.295062 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.295033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czhrh\" (UniqueName: \"kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh\") pod \"maas-controller-7db556d9cb-njr8m\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.413040 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.413014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:34.414467 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:57:34.414435 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f47ca0_0a3c_414b_a6e8_1358ed149657.slice/crio-93dfb549d5e5446c7366f42d0cb60cdeab31f32e305749041fbda3fb0d185740 WatchSource:0}: Error finding container 93dfb549d5e5446c7366f42d0cb60cdeab31f32e305749041fbda3fb0d185740: Status 404 returned error can't find the container with id 93dfb549d5e5446c7366f42d0cb60cdeab31f32e305749041fbda3fb0d185740 Jun 09 21:57:34.427622 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.427601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:34.513536 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.513502 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78986f5cb6-74xjx" event={"ID":"c0f47ca0-0a3c-414b-a6e8-1358ed149657","Type":"ContainerStarted","Data":"93dfb549d5e5446c7366f42d0cb60cdeab31f32e305749041fbda3fb0d185740"} Jun 09 21:57:34.574405 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:34.574378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 21:57:34.576445 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:57:34.576412 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f9d749_2931_4735_9944_ca5d819ce412.slice/crio-e620ed7354065a7d40e99c1a8072f033804fb993fa7eded09156d43d496ac36e WatchSource:0}: Error finding container e620ed7354065a7d40e99c1a8072f033804fb993fa7eded09156d43d496ac36e: Status 404 returned error can't find the container with id e620ed7354065a7d40e99c1a8072f033804fb993fa7eded09156d43d496ac36e Jun 09 21:57:35.522212 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:35.522124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-njr8m" event={"ID":"b6f9d749-2931-4735-9944-ca5d819ce412","Type":"ContainerStarted","Data":"e620ed7354065a7d40e99c1a8072f033804fb993fa7eded09156d43d496ac36e"} Jun 09 21:57:37.535408 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.535371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78986f5cb6-74xjx" event={"ID":"c0f47ca0-0a3c-414b-a6e8-1358ed149657","Type":"ContainerStarted","Data":"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d"} Jun 09 21:57:37.535926 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.535453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:37.537085 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.537057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-njr8m" event={"ID":"b6f9d749-2931-4735-9944-ca5d819ce412","Type":"ContainerStarted","Data":"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3"} Jun 09 21:57:37.537199 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.537184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:37.553241 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.553192 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78986f5cb6-74xjx" podStartSLOduration=1.865961935 podStartE2EDuration="4.553174732s" totalImagesPullingTime="2.687212797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:57:37.550773725 +0000 UTC m=+745.518242633" watchObservedRunningTime="2026-06-09 21:57:37.553174732 +0000 UTC m=+745.520643638" Jun 09 21:57:37.568426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:37.568376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db556d9cb-njr8m" podStartSLOduration=1.039134496 podStartE2EDuration="3.568360465s" totalImagesPullingTime="2.529225969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:57:37.566489747 +0000 UTC m=+745.533958589" watchObservedRunningTime="2026-06-09 21:57:37.568360465 +0000 UTC m=+745.535829306" Jun 09 21:57:48.546455 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.546424 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:48.547222 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.546495 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 21:57:48.592444 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.592404 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:48.592632 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.592605 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78986f5cb6-74xjx" podUID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" containerName="manager" containerID="cri-o://8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d" gracePeriod=30 Jun 09 21:57:48.843933 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.843906 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:48.914221 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.914177 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz78j\" (UniqueName: \"kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j\") pod \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " Jun 09 21:57:48.914391 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.914277 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert\") pod \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\" (UID: \"c0f47ca0-0a3c-414b-a6e8-1358ed149657\") " Jun 09 21:57:48.916526 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.916501 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c0f47ca0-0a3c-414b-a6e8-1358ed149657" (UID: "c0f47ca0-0a3c-414b-a6e8-1358ed149657"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:57:48.916526 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:48.916508 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j" (OuterVolumeSpecName: "kube-api-access-jz78j") pod "c0f47ca0-0a3c-414b-a6e8-1358ed149657" (UID: "c0f47ca0-0a3c-414b-a6e8-1358ed149657"). InnerVolumeSpecName "kube-api-access-jz78j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:57:49.015423 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.015381 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz78j\" (UniqueName: \"kubernetes.io/projected/c0f47ca0-0a3c-414b-a6e8-1358ed149657-kube-api-access-jz78j\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:57:49.015423 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.015413 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0f47ca0-0a3c-414b-a6e8-1358ed149657-webhook-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:57:49.596920 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.596886 2579 generic.go:356] "Generic (PLEG): container finished" podID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" containerID="8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d" exitCode=0 Jun 09 21:57:49.597309 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.596935 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78986f5cb6-74xjx" Jun 09 21:57:49.597309 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.596952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78986f5cb6-74xjx" event={"ID":"c0f47ca0-0a3c-414b-a6e8-1358ed149657","Type":"ContainerDied","Data":"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d"} Jun 09 21:57:49.597309 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.596994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78986f5cb6-74xjx" event={"ID":"c0f47ca0-0a3c-414b-a6e8-1358ed149657","Type":"ContainerDied","Data":"93dfb549d5e5446c7366f42d0cb60cdeab31f32e305749041fbda3fb0d185740"} Jun 09 21:57:49.597309 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.597015 2579 scope.go:117] "RemoveContainer" containerID="8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d" Jun 09 21:57:49.606234 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.606213 2579 scope.go:117] "RemoveContainer" containerID="8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d" Jun 09 21:57:49.606482 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:57:49.606467 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d\": container with ID starting with 8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d not found: ID does not exist" containerID="8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d" Jun 09 21:57:49.606520 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.606489 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d"} err="failed to get container status \"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d\": rpc error: code = NotFound desc = could not find container \"8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d\": container with ID starting with 8622f9d1146bb75b822bb63c1352969433bec5bf8114dd65dd4a857c7385960d not found: ID does not exist" Jun 09 21:57:49.616830 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.616808 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:49.620831 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:49.620809 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78986f5cb6-74xjx"] Jun 09 21:57:50.514940 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:57:50.514897 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" path="/var/lib/kubelet/pods/c0f47ca0-0a3c-414b-a6e8-1358ed149657/volumes" Jun 09 21:58:08.455681 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.455620 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6ffc599675-wnw5x"] Jun 09 21:58:08.456243 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.456215 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" containerName="manager" Jun 09 21:58:08.456243 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.456241 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" containerName="manager" Jun 09 21:58:08.456402 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.456333 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f47ca0-0a3c-414b-a6e8-1358ed149657" containerName="manager" Jun 09 21:58:08.462302 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.462283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:08.464696 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.464675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 21:58:08.464883 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.464860 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2sp5n\"" Jun 09 21:58:08.470779 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.470744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6ffc599675-wnw5x"] Jun 09 21:58:08.590682 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.590621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4fmg\" (UniqueName: \"kubernetes.io/projected/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-kube-api-access-d4fmg\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:08.590863 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.590722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:08.691171 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.691145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4fmg\" (UniqueName: \"kubernetes.io/projected/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-kube-api-access-d4fmg\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:08.691352 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.691193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:08.691352 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:58:08.691330 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 21:58:08.691472 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:58:08.691396 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls podName:5b06ce78-8a40-4d44-94cc-2ce5b2912eef nodeName:}" failed. No retries permitted until 2026-06-09 21:58:09.191377965 +0000 UTC m=+777.158846785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls") pod "maas-api-6ffc599675-wnw5x" (UID: "5b06ce78-8a40-4d44-94cc-2ce5b2912eef") : secret "maas-api-serving-cert" not found Jun 09 21:58:08.701584 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:08.701555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4fmg\" (UniqueName: \"kubernetes.io/projected/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-kube-api-access-d4fmg\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:09.196550 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.196511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:09.199356 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.199330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b06ce78-8a40-4d44-94cc-2ce5b2912eef-maas-api-tls\") pod \"maas-api-6ffc599675-wnw5x\" (UID: \"5b06ce78-8a40-4d44-94cc-2ce5b2912eef\") " pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:09.373761 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.373725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:09.521860 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.521831 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6ffc599675-wnw5x"] Jun 09 21:58:09.524690 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:58:09.524657 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b06ce78_8a40_4d44_94cc_2ce5b2912eef.slice/crio-cb904f3db7fc7ff9d4c01849021fe0d2dad4df7048b32b6fb6d06d7955ee5746 WatchSource:0}: Error finding container cb904f3db7fc7ff9d4c01849021fe0d2dad4df7048b32b6fb6d06d7955ee5746: Status 404 returned error can't find the container with id cb904f3db7fc7ff9d4c01849021fe0d2dad4df7048b32b6fb6d06d7955ee5746 Jun 09 21:58:09.526145 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.526126 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:58:09.696608 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:09.696575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6ffc599675-wnw5x" event={"ID":"5b06ce78-8a40-4d44-94cc-2ce5b2912eef","Type":"ContainerStarted","Data":"cb904f3db7fc7ff9d4c01849021fe0d2dad4df7048b32b6fb6d06d7955ee5746"} Jun 09 21:58:11.707272 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:11.707234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6ffc599675-wnw5x" event={"ID":"5b06ce78-8a40-4d44-94cc-2ce5b2912eef","Type":"ContainerStarted","Data":"c20acbdbba788098b1052252fc10dc0eeab5a9a5eeb77489471252fd196c2093"} Jun 09 21:58:11.707686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:11.707368 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:11.722738 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:11.722690 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6ffc599675-wnw5x" podStartSLOduration=2.164956104 podStartE2EDuration="3.722656355s" totalImagesPullingTime="1.557700251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:58:11.721823135 +0000 UTC m=+779.689291977" watchObservedRunningTime="2026-06-09 21:58:11.722656355 +0000 UTC m=+779.690125189" Jun 09 21:58:17.717704 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:17.717674 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6ffc599675-wnw5x" Jun 09 21:58:19.432808 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:19.432727 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:19.433209 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:19.432939 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" containerID="cri-o://ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611" gracePeriod=30 Jun 09 21:58:21.083977 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.083951 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.114410 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.114315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72gv\" (UniqueName: \"kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv\") pod \"619bef53-b2d7-4225-90b6-e241415d2ccd\" (UID: \"619bef53-b2d7-4225-90b6-e241415d2ccd\") " Jun 09 21:58:21.116578 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.116551 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv" (OuterVolumeSpecName: "kube-api-access-c72gv") pod "619bef53-b2d7-4225-90b6-e241415d2ccd" (UID: "619bef53-b2d7-4225-90b6-e241415d2ccd"). InnerVolumeSpecName "kube-api-access-c72gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:58:21.215441 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.215407 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72gv\" (UniqueName: \"kubernetes.io/projected/619bef53-b2d7-4225-90b6-e241415d2ccd-kube-api-access-c72gv\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:58:21.756659 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.756609 2579 generic.go:356] "Generic (PLEG): container finished" podID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerID="ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611" exitCode=143 Jun 09 21:58:21.756868 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.756677 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.756868 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.756704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"619bef53-b2d7-4225-90b6-e241415d2ccd","Type":"ContainerDied","Data":"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611"} Jun 09 21:58:21.756868 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.756765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"619bef53-b2d7-4225-90b6-e241415d2ccd","Type":"ContainerDied","Data":"3b636dc16409bbf19c09fbc28e2fcfc2aed91fd976f556fc5aacdcfd8c72f12d"} Jun 09 21:58:21.756868 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.756791 2579 scope.go:117] "RemoveContainer" containerID="ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611" Jun 09 21:58:21.766873 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.766857 2579 scope.go:117] "RemoveContainer" containerID="ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611" Jun 09 21:58:21.767138 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:58:21.767119 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611\": container with ID starting with ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611 not found: ID does not exist" containerID="ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611" Jun 09 21:58:21.767207 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.767147 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611"} err="failed to get container status \"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611\": rpc error: code = NotFound desc = could not find container \"ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611\": container with ID starting with ff52a5df4f6e3e3e03f0af91aca56f4313267a7caa5ce7b545af380d9231d611 not found: ID does not exist" Jun 09 21:58:21.777259 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.777232 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:21.780249 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.780230 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:21.800741 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.800715 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:21.801113 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.801070 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" Jun 09 21:58:21.801113 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.801086 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" Jun 09 21:58:21.801219 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.801138 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" containerName="keycloak" Jun 09 21:58:21.805431 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.805415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.808078 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.808057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 21:58:21.808194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.808058 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 21:58:21.808194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.808058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 21:58:21.808194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.808061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sxqcx\"" Jun 09 21:58:21.808194 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.808115 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 21:58:21.812748 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.812726 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:21.822010 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.821971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4e21accc-f4a1-498a-afe8-5e8c121626c1-test-realms\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.822307 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.822283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rbn6\" (UniqueName: \"kubernetes.io/projected/4e21accc-f4a1-498a-afe8-5e8c121626c1-kube-api-access-4rbn6\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.923686 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.923629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rbn6\" (UniqueName: \"kubernetes.io/projected/4e21accc-f4a1-498a-afe8-5e8c121626c1-kube-api-access-4rbn6\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.923857 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.923729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4e21accc-f4a1-498a-afe8-5e8c121626c1-test-realms\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.924368 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.924348 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4e21accc-f4a1-498a-afe8-5e8c121626c1-test-realms\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:21.931132 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:21.931105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rbn6\" (UniqueName: \"kubernetes.io/projected/4e21accc-f4a1-498a-afe8-5e8c121626c1-kube-api-access-4rbn6\") pod \"maas-keycloak-0\" (UID: \"4e21accc-f4a1-498a-afe8-5e8c121626c1\") " pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:22.117039 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.116937 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:22.251419 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.251396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 21:58:22.254567 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:58:22.254539 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e21accc_f4a1_498a_afe8_5e8c121626c1.slice/crio-7df18d4eb1dd264193154fbda234bd0393ac8eca3a37d8b691dd0cd3e0029ef0 WatchSource:0}: Error finding container 7df18d4eb1dd264193154fbda234bd0393ac8eca3a37d8b691dd0cd3e0029ef0: Status 404 returned error can't find the container with id 7df18d4eb1dd264193154fbda234bd0393ac8eca3a37d8b691dd0cd3e0029ef0 Jun 09 21:58:22.514115 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.514081 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619bef53-b2d7-4225-90b6-e241415d2ccd" path="/var/lib/kubelet/pods/619bef53-b2d7-4225-90b6-e241415d2ccd/volumes" Jun 09 21:58:22.764852 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.764762 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e21accc-f4a1-498a-afe8-5e8c121626c1","Type":"ContainerStarted","Data":"deefa52d5bbef3b1780ff9dfa4d97cf06078857778377fcd1d60c4ab951b04d2"} Jun 09 21:58:22.764852 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.764827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e21accc-f4a1-498a-afe8-5e8c121626c1","Type":"ContainerStarted","Data":"7df18d4eb1dd264193154fbda234bd0393ac8eca3a37d8b691dd0cd3e0029ef0"} Jun 09 21:58:22.783379 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:22.783178 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.390414951 podStartE2EDuration="1.783160206s" totalImagesPullingTime="392.745255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:58:22.782596307 +0000 UTC m=+790.750065137" watchObservedRunningTime="2026-06-09 21:58:22.783160206 +0000 UTC m=+790.750629048" Jun 09 21:58:23.117672 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:23.117552 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:23.119587 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:23.119539 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:24.117990 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:24.117927 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:25.118238 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:25.118178 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:26.118117 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:26.118066 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:27.118239 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:27.118186 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:28.118258 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:28.118202 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:29.118426 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:29.118366 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:30.118159 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:30.118104 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:31.117383 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:31.117326 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:32.117993 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:32.117919 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:32.118460 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:32.118279 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:33.117518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:33.117450 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:34.118304 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:34.118256 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:35.118300 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:35.118247 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 09 21:58:36.248864 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:36.248830 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:36.269230 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:36.269181 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4e21accc-f4a1-498a-afe8-5e8c121626c1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:58:46.255517 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:46.255480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 21:58:56.922420 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.922388 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 21:58:56.926034 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.926014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:56.928323 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.928300 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 21:58:56.932059 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.932038 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 21:58:56.976262 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.976226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:56.976460 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.976332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5m7f\" (UniqueName: \"kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:56.976460 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:56.976363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.077545 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.077508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5m7f\" (UniqueName: \"kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.077545 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.077546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.077833 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.077600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.078333 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.078308 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.080256 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.080233 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.087549 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.087529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5m7f\" (UniqueName: \"kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f\") pod \"authorino-74b7748668-zkg2m\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.236539 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.236461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 21:58:57.373813 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.373788 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 21:58:57.376023 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:58:57.375998 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86147b8b_7523_4d4a_b8ca_c3970e4c27ee.slice/crio-94d74735becb2922cf2465245e667fa140fafafb7647d15b5537db956644235f WatchSource:0}: Error finding container 94d74735becb2922cf2465245e667fa140fafafb7647d15b5537db956644235f: Status 404 returned error can't find the container with id 94d74735becb2922cf2465245e667fa140fafafb7647d15b5537db956644235f Jun 09 21:58:57.978487 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.978449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7748668-zkg2m" event={"ID":"86147b8b-7523-4d4a-b8ca-c3970e4c27ee","Type":"ContainerStarted","Data":"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993"} Jun 09 21:58:57.978487 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.978496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7748668-zkg2m" event={"ID":"86147b8b-7523-4d4a-b8ca-c3970e4c27ee","Type":"ContainerStarted","Data":"94d74735becb2922cf2465245e667fa140fafafb7647d15b5537db956644235f"} Jun 09 21:58:57.993997 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:57.993949 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74b7748668-zkg2m" podStartSLOduration=1.576554605 podStartE2EDuration="1.99393326s" totalImagesPullingTime="417.378655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:58:57.992226798 +0000 UTC m=+825.959695639" watchObservedRunningTime="2026-06-09 21:58:57.99393326 +0000 UTC m=+825.961402132" Jun 09 21:58:58.020423 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.020379 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:58:58.020628 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.020603 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" podUID="31d8ee69-4a8a-488f-88c5-c46623d97047" containerName="authorino" containerID="cri-o://4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a" gracePeriod=30 Jun 09 21:58:58.314375 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.314347 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:58:58.388544 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.388506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7vww\" (UniqueName: \"kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww\") pod \"31d8ee69-4a8a-488f-88c5-c46623d97047\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " Jun 09 21:58:58.388776 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.388590 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert\") pod \"31d8ee69-4a8a-488f-88c5-c46623d97047\" (UID: \"31d8ee69-4a8a-488f-88c5-c46623d97047\") " Jun 09 21:58:58.396210 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.396056 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww" (OuterVolumeSpecName: "kube-api-access-z7vww") pod "31d8ee69-4a8a-488f-88c5-c46623d97047" (UID: "31d8ee69-4a8a-488f-88c5-c46623d97047"). InnerVolumeSpecName "kube-api-access-z7vww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:58:58.405053 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.405009 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "31d8ee69-4a8a-488f-88c5-c46623d97047" (UID: "31d8ee69-4a8a-488f-88c5-c46623d97047"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:58:58.489499 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.489451 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7vww\" (UniqueName: \"kubernetes.io/projected/31d8ee69-4a8a-488f-88c5-c46623d97047-kube-api-access-z7vww\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:58:58.489499 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.489495 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31d8ee69-4a8a-488f-88c5-c46623d97047-tls-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 21:58:58.985113 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.985074 2579 generic.go:356] "Generic (PLEG): container finished" podID="31d8ee69-4a8a-488f-88c5-c46623d97047" containerID="4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a" exitCode=0 Jun 09 21:58:58.985518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.985125 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" Jun 09 21:58:58.985518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.985157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" event={"ID":"31d8ee69-4a8a-488f-88c5-c46623d97047","Type":"ContainerDied","Data":"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a"} Jun 09 21:58:58.985518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.985197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cddb9cd98-k8t28" event={"ID":"31d8ee69-4a8a-488f-88c5-c46623d97047","Type":"ContainerDied","Data":"aa17a1b3e394a56605174e64ea98406914072db4721cdf9ebbbdf0549ba6ade4"} Jun 09 21:58:58.985518 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.985214 2579 scope.go:117] "RemoveContainer" containerID="4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a" Jun 09 21:58:58.993839 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.993816 2579 scope.go:117] "RemoveContainer" containerID="4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a" Jun 09 21:58:58.994146 ip-10-0-128-8 kubenswrapper[2579]: E0609 21:58:58.994126 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a\": container with ID starting with 4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a not found: ID does not exist" containerID="4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a" Jun 09 21:58:58.994214 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:58.994154 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a"} err="failed to get container status \"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a\": rpc error: code = NotFound desc = could not find container \"4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a\": container with ID starting with 4b69070f9cb0fbfe84fe4b4ccf494e559975ec084f3db779ac70d05e0db79b8a not found: ID does not exist" Jun 09 21:58:59.001968 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:59.001945 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:58:59.005542 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:58:59.005522 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cddb9cd98-k8t28"] Jun 09 21:59:00.517742 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:00.517707 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d8ee69-4a8a-488f-88c5-c46623d97047" path="/var/lib/kubelet/pods/31d8ee69-4a8a-488f-88c5-c46623d97047/volumes" Jun 09 21:59:33.248230 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.248196 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84"] Jun 09 21:59:33.248907 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.248769 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d8ee69-4a8a-488f-88c5-c46623d97047" containerName="authorino" Jun 09 21:59:33.248907 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.248790 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d8ee69-4a8a-488f-88c5-c46623d97047" containerName="authorino" Jun 09 21:59:33.249047 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.248918 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31d8ee69-4a8a-488f-88c5-c46623d97047" containerName="authorino" Jun 09 21:59:33.252310 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.252288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.255597 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.255575 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zghg\"" Jun 09 21:59:33.255738 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.255627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 21:59:33.255738 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.255628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 21:59:33.255738 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.255729 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 21:59:33.261557 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.261533 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84"] Jun 09 21:59:33.400844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.400814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.400844 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.400848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.401094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.400928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.401094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.400956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41827891-d288-4394-be11-246c0843f5ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.401094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.400978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.401094 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.401018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdpq\" (UniqueName: \"kubernetes.io/projected/41827891-d288-4394-be11-246c0843f5ab-kube-api-access-hwdpq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502089 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.501979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41827891-d288-4394-be11-246c0843f5ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502089 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502089 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdpq\" (UniqueName: \"kubernetes.io/projected/41827891-d288-4394-be11-246c0843f5ab-kube-api-access-hwdpq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502386 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502504 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502545 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.502733 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.502710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.504545 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.504520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41827891-d288-4394-be11-246c0843f5ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.504977 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.504956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41827891-d288-4394-be11-246c0843f5ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.510326 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.510298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdpq\" (UniqueName: \"kubernetes.io/projected/41827891-d288-4394-be11-246c0843f5ab-kube-api-access-hwdpq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84\" (UID: \"41827891-d288-4394-be11-246c0843f5ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.563804 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.563763 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 21:59:33.700112 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:33.700087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84"] Jun 09 21:59:33.702265 ip-10-0-128-8 kubenswrapper[2579]: W0609 21:59:33.702233 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41827891_d288_4394_be11_246c0843f5ab.slice/crio-0ee6e51c417da14d232154971635a44a7b5db069804bc078dfc702fdd78b8e14 WatchSource:0}: Error finding container 0ee6e51c417da14d232154971635a44a7b5db069804bc078dfc702fdd78b8e14: Status 404 returned error can't find the container with id 0ee6e51c417da14d232154971635a44a7b5db069804bc078dfc702fdd78b8e14 Jun 09 21:59:34.148934 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:34.148889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" event={"ID":"41827891-d288-4394-be11-246c0843f5ab","Type":"ContainerStarted","Data":"0ee6e51c417da14d232154971635a44a7b5db069804bc078dfc702fdd78b8e14"} Jun 09 21:59:37.166603 ip-10-0-128-8 kubenswrapper[2579]: I0609 21:59:37.166571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" event={"ID":"41827891-d288-4394-be11-246c0843f5ab","Type":"ContainerStarted","Data":"9bc0d967653a155615c21b8358ea1fe0a708e7f4f3fe9ac1d76c355468bde6e3"} Jun 09 22:00:04.947159 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:04.947119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv"] Jun 09 22:00:04.965889 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:04.965854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv"] Jun 09 22:00:04.966040 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:04.965970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:04.968529 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:04.968504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 22:00:05.083632 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.083842 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.083842 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083711 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.083842 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjnkj\" (UniqueName: \"kubernetes.io/projected/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kube-api-access-gjnkj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.084010 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.084010 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.083907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.184537 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.184537 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.184850 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjnkj\" (UniqueName: \"kubernetes.io/projected/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kube-api-access-gjnkj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.184850 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.184850 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.185005 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.185057 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.184998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.185209 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.185187 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.185276 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.185259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.187095 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.187070 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.187377 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.187358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.192399 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.192373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjnkj\" (UniqueName: \"kubernetes.io/projected/e8e2178a-e10d-4f90-8853-dc22f18b9d4d-kube-api-access-gjnkj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv\" (UID: \"e8e2178a-e10d-4f90-8853-dc22f18b9d4d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.277206 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.277112 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:05.419511 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:05.419472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv"] Jun 09 22:00:05.423434 ip-10-0-128-8 kubenswrapper[2579]: W0609 22:00:05.423391 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e2178a_e10d_4f90_8853_dc22f18b9d4d.slice/crio-74bce469d9959b7907ac104302cc04144ef2548edef51561c2439f05aa42a851 WatchSource:0}: Error finding container 74bce469d9959b7907ac104302cc04144ef2548edef51561c2439f05aa42a851: Status 404 returned error can't find the container with id 74bce469d9959b7907ac104302cc04144ef2548edef51561c2439f05aa42a851 Jun 09 22:00:06.311854 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:06.311807 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" event={"ID":"e8e2178a-e10d-4f90-8853-dc22f18b9d4d","Type":"ContainerStarted","Data":"2be915c193b34ccf135295d02a8cde8cdea394c0f2f42a951fdcf94d4e79bd03"} Jun 09 22:00:06.312250 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:06.311889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" event={"ID":"e8e2178a-e10d-4f90-8853-dc22f18b9d4d","Type":"ContainerStarted","Data":"74bce469d9959b7907ac104302cc04144ef2548edef51561c2439f05aa42a851"} Jun 09 22:00:07.318775 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:07.318733 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8e2178a-e10d-4f90-8853-dc22f18b9d4d" containerID="2be915c193b34ccf135295d02a8cde8cdea394c0f2f42a951fdcf94d4e79bd03" exitCode=0 Jun 09 22:00:07.319130 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:07.318793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" event={"ID":"e8e2178a-e10d-4f90-8853-dc22f18b9d4d","Type":"ContainerDied","Data":"2be915c193b34ccf135295d02a8cde8cdea394c0f2f42a951fdcf94d4e79bd03"} Jun 09 22:00:12.510103 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:12.510076 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:00:12.511811 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:12.511787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:00:12.519242 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:12.519206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:00:12.520319 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:12.520298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:00:30.436146 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:30.436110 2579 generic.go:356] "Generic (PLEG): container finished" podID="41827891-d288-4394-be11-246c0843f5ab" containerID="9bc0d967653a155615c21b8358ea1fe0a708e7f4f3fe9ac1d76c355468bde6e3" exitCode=0 Jun 09 22:00:30.436574 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:30.436156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" event={"ID":"41827891-d288-4394-be11-246c0843f5ab","Type":"ContainerDied","Data":"9bc0d967653a155615c21b8358ea1fe0a708e7f4f3fe9ac1d76c355468bde6e3"} Jun 09 22:00:32.448110 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:32.448070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" event={"ID":"41827891-d288-4394-be11-246c0843f5ab","Type":"ContainerStarted","Data":"5ffffea3f29cc6c2963b16cda8f0867323835f3a221e37fe97a24871823d398b"} Jun 09 22:00:32.464295 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:32.464248 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" podStartSLOduration=2.074602245 podStartE2EDuration="59.464230362s" totalImagesPullingTime="3.938261066s" totalInitContainerRuntime="53.451367051s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:59:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:00:32.463895134 +0000 UTC m=+920.431363978" watchObservedRunningTime="2026-06-09 22:00:32.464230362 +0000 UTC m=+920.431699204" Jun 09 22:00:33.455089 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:33.455052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" event={"ID":"e8e2178a-e10d-4f90-8853-dc22f18b9d4d","Type":"ContainerStarted","Data":"7439c0d8c7ef723673de3852706e9e3664ccf01c18f6d3b5b75be6a6b888f042"} Jun 09 22:00:33.472841 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:33.472787 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" podStartSLOduration=2.153386205 podStartE2EDuration="29.472767091s" totalImagesPullingTime="25.981097504s" totalInitContainerRuntime="1.338283382s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:00:33.471291609 +0000 UTC m=+921.438760449" watchObservedRunningTime="2026-06-09 22:00:33.472767091 +0000 UTC m=+921.440235931" Jun 09 22:00:33.564458 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:33.564366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 22:00:33.564458 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:33.564433 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 22:00:33.577104 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:33.577079 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 22:00:34.471562 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:34.471532 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84" Jun 09 22:00:35.277420 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:35.277389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:35.277629 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:35.277454 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:35.293263 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:35.293232 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:00:35.476477 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:00:35.476448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv" Jun 09 22:01:39.985600 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:39.985557 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-685f4c745c-zr6vl"] Jun 09 22:01:39.987961 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:39.987944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.005418 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.005381 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685f4c745c-zr6vl"] Jun 09 22:01:40.070040 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.069998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwlrv\" (UniqueName: \"kubernetes.io/projected/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-kube-api-access-gwlrv\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.070240 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.070067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-tls-cert\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.070311 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.070235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-oidc-ca\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.170999 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.170958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwlrv\" (UniqueName: \"kubernetes.io/projected/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-kube-api-access-gwlrv\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.171219 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.171024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-tls-cert\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.171219 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.171099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-oidc-ca\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.171874 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.171856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-oidc-ca\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.173815 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.173797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-tls-cert\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.178554 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.178530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwlrv\" (UniqueName: \"kubernetes.io/projected/54f937ab-a9fa-4039-a361-e9d4fc09a8c1-kube-api-access-gwlrv\") pod \"authorino-685f4c745c-zr6vl\" (UID: \"54f937ab-a9fa-4039-a361-e9d4fc09a8c1\") " pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.297814 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.297724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685f4c745c-zr6vl" Jun 09 22:01:40.437792 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.437764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685f4c745c-zr6vl"] Jun 09 22:01:40.440062 ip-10-0-128-8 kubenswrapper[2579]: W0609 22:01:40.440030 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54f937ab_a9fa_4039_a361_e9d4fc09a8c1.slice/crio-fa20106dcb8343f84bb212783a22d4b3d5e37092fbc840bb296c42f2c531ccb8 WatchSource:0}: Error finding container fa20106dcb8343f84bb212783a22d4b3d5e37092fbc840bb296c42f2c531ccb8: Status 404 returned error can't find the container with id fa20106dcb8343f84bb212783a22d4b3d5e37092fbc840bb296c42f2c531ccb8 Jun 09 22:01:40.782946 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:40.782908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685f4c745c-zr6vl" event={"ID":"54f937ab-a9fa-4039-a361-e9d4fc09a8c1","Type":"ContainerStarted","Data":"fa20106dcb8343f84bb212783a22d4b3d5e37092fbc840bb296c42f2c531ccb8"} Jun 09 22:01:41.789068 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:41.789026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685f4c745c-zr6vl" event={"ID":"54f937ab-a9fa-4039-a361-e9d4fc09a8c1","Type":"ContainerStarted","Data":"ac28ff044aea1d8b29134ce71e1e8970389d8db1dcc0450f081c8eb3fbc7cfc7"} Jun 09 22:01:41.803854 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:41.803797 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-685f4c745c-zr6vl" podStartSLOduration=2.051176644 podStartE2EDuration="2.803779196s" totalImagesPullingTime="752.602552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:01:41.802374435 +0000 UTC m=+989.769843276" watchObservedRunningTime="2026-06-09 22:01:41.803779196 +0000 UTC m=+989.771248038" Jun 09 22:01:41.833782 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:41.833739 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 22:01:41.834310 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:41.834265 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74b7748668-zkg2m" podUID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" containerName="authorino" containerID="cri-o://8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993" gracePeriod=30 Jun 09 22:01:42.104873 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.104845 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 22:01:42.190362 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.190307 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca\") pod \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " Jun 09 22:01:42.190567 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.190386 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5m7f\" (UniqueName: \"kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f\") pod \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " Jun 09 22:01:42.190567 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.190422 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert\") pod \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\" (UID: \"86147b8b-7523-4d4a-b8ca-c3970e4c27ee\") " Jun 09 22:01:42.192614 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.192577 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f" (OuterVolumeSpecName: "kube-api-access-q5m7f") pod "86147b8b-7523-4d4a-b8ca-c3970e4c27ee" (UID: "86147b8b-7523-4d4a-b8ca-c3970e4c27ee"). InnerVolumeSpecName "kube-api-access-q5m7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:01:42.195504 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.195478 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "86147b8b-7523-4d4a-b8ca-c3970e4c27ee" (UID: "86147b8b-7523-4d4a-b8ca-c3970e4c27ee"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 22:01:42.201164 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.201138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "86147b8b-7523-4d4a-b8ca-c3970e4c27ee" (UID: "86147b8b-7523-4d4a-b8ca-c3970e4c27ee"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 22:01:42.291534 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.291492 2579 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-oidc-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:01:42.291534 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.291530 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5m7f\" (UniqueName: \"kubernetes.io/projected/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-kube-api-access-q5m7f\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:01:42.291534 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.291543 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86147b8b-7523-4d4a-b8ca-c3970e4c27ee-tls-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:01:42.794410 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.794332 2579 generic.go:356] "Generic (PLEG): container finished" podID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" containerID="8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993" exitCode=0 Jun 09 22:01:42.794410 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.794381 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7748668-zkg2m" Jun 09 22:01:42.794895 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.794420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7748668-zkg2m" event={"ID":"86147b8b-7523-4d4a-b8ca-c3970e4c27ee","Type":"ContainerDied","Data":"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993"} Jun 09 22:01:42.794895 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.794463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7748668-zkg2m" event={"ID":"86147b8b-7523-4d4a-b8ca-c3970e4c27ee","Type":"ContainerDied","Data":"94d74735becb2922cf2465245e667fa140fafafb7647d15b5537db956644235f"} Jun 09 22:01:42.794895 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.794483 2579 scope.go:117] "RemoveContainer" containerID="8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993" Jun 09 22:01:42.803870 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.803822 2579 scope.go:117] "RemoveContainer" containerID="8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993" Jun 09 22:01:42.804137 ip-10-0-128-8 kubenswrapper[2579]: E0609 22:01:42.804119 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993\": container with ID starting with 8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993 not found: ID does not exist" containerID="8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993" Jun 09 22:01:42.804195 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.804142 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993"} err="failed to get container status \"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993\": rpc error: code = NotFound desc = could not find container \"8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993\": container with ID starting with 8b3a7a8c22f7697269041fb5d1551a1936cb172a9da10226397f71d087a49993 not found: ID does not exist" Jun 09 22:01:42.810199 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.810171 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 22:01:42.813459 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:42.813435 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74b7748668-zkg2m"] Jun 09 22:01:44.515226 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:01:44.515189 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" path="/var/lib/kubelet/pods/86147b8b-7523-4d4a-b8ca-c3970e4c27ee/volumes" Jun 09 22:03:11.191169 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.191128 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 22:03:11.191714 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.191381 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7db556d9cb-njr8m" podUID="b6f9d749-2931-4735-9944-ca5d819ce412" containerName="manager" containerID="cri-o://666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3" gracePeriod=30 Jun 09 22:03:11.435760 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.435734 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 22:03:11.509933 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.509857 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert\") pod \"b6f9d749-2931-4735-9944-ca5d819ce412\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " Jun 09 22:03:11.510064 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.509969 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czhrh\" (UniqueName: \"kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh\") pod \"b6f9d749-2931-4735-9944-ca5d819ce412\" (UID: \"b6f9d749-2931-4735-9944-ca5d819ce412\") " Jun 09 22:03:11.511964 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.511937 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b6f9d749-2931-4735-9944-ca5d819ce412" (UID: "b6f9d749-2931-4735-9944-ca5d819ce412"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 22:03:11.512104 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.512012 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh" (OuterVolumeSpecName: "kube-api-access-czhrh") pod "b6f9d749-2931-4735-9944-ca5d819ce412" (UID: "b6f9d749-2931-4735-9944-ca5d819ce412"). InnerVolumeSpecName "kube-api-access-czhrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:03:11.610880 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.610839 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czhrh\" (UniqueName: \"kubernetes.io/projected/b6f9d749-2931-4735-9944-ca5d819ce412-kube-api-access-czhrh\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:03:11.610880 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:11.610878 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6f9d749-2931-4735-9944-ca5d819ce412-webhook-cert\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:03:12.241011 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.240979 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6f9d749-2931-4735-9944-ca5d819ce412" containerID="666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3" exitCode=0 Jun 09 22:03:12.241462 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.241022 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-njr8m" Jun 09 22:03:12.241462 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.241026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-njr8m" event={"ID":"b6f9d749-2931-4735-9944-ca5d819ce412","Type":"ContainerDied","Data":"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3"} Jun 09 22:03:12.241462 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.241080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-njr8m" event={"ID":"b6f9d749-2931-4735-9944-ca5d819ce412","Type":"ContainerDied","Data":"e620ed7354065a7d40e99c1a8072f033804fb993fa7eded09156d43d496ac36e"} Jun 09 22:03:12.241462 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.241110 2579 scope.go:117] "RemoveContainer" containerID="666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3" Jun 09 22:03:12.250723 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.250705 2579 scope.go:117] "RemoveContainer" containerID="666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3" Jun 09 22:03:12.251002 ip-10-0-128-8 kubenswrapper[2579]: E0609 22:03:12.250982 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3\": container with ID starting with 666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3 not found: ID does not exist" containerID="666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3" Jun 09 22:03:12.251069 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.251020 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3"} err="failed to get container status \"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3\": rpc error: code = NotFound desc = could not find container \"666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3\": container with ID starting with 666bcc79c60644a84a203387f57e97b6f02aff32149a6fe094e879787be839a3 not found: ID does not exist" Jun 09 22:03:12.261519 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.261497 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 22:03:12.263105 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.263084 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-njr8m"] Jun 09 22:03:12.516616 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:12.516535 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f9d749-2931-4735-9944-ca5d819ce412" path="/var/lib/kubelet/pods/b6f9d749-2931-4735-9944-ca5d819ce412/volumes" Jun 09 22:03:13.012805 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.012774 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db556d9cb-cc8cn"] Jun 09 22:03:13.013190 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013175 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" containerName="authorino" Jun 09 22:03:13.013242 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013193 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" containerName="authorino" Jun 09 22:03:13.013242 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013210 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f9d749-2931-4735-9944-ca5d819ce412" containerName="manager" Jun 09 22:03:13.013242 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013216 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f9d749-2931-4735-9944-ca5d819ce412" containerName="manager" Jun 09 22:03:13.013332 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013280 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86147b8b-7523-4d4a-b8ca-c3970e4c27ee" containerName="authorino" Jun 09 22:03:13.013332 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.013294 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f9d749-2931-4735-9944-ca5d819ce412" containerName="manager" Jun 09 22:03:13.017770 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.017738 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.020050 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.020027 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 22:03:13.021160 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.021137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 22:03:13.021276 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.021174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w6mdz\"" Jun 09 22:03:13.023715 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.023690 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-cc8cn"] Jun 09 22:03:13.124348 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.124319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59t9r\" (UniqueName: \"kubernetes.io/projected/403d8f9e-8b32-4d9f-9472-ad08da6b3847-kube-api-access-59t9r\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.124527 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.124361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/403d8f9e-8b32-4d9f-9472-ad08da6b3847-webhook-cert\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.225684 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.225618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59t9r\" (UniqueName: \"kubernetes.io/projected/403d8f9e-8b32-4d9f-9472-ad08da6b3847-kube-api-access-59t9r\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.225863 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.225714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/403d8f9e-8b32-4d9f-9472-ad08da6b3847-webhook-cert\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.228305 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.228280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/403d8f9e-8b32-4d9f-9472-ad08da6b3847-webhook-cert\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.233368 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.233343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59t9r\" (UniqueName: \"kubernetes.io/projected/403d8f9e-8b32-4d9f-9472-ad08da6b3847-kube-api-access-59t9r\") pod \"maas-controller-7db556d9cb-cc8cn\" (UID: \"403d8f9e-8b32-4d9f-9472-ad08da6b3847\") " pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.330917 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.330817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:13.465155 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.465136 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db556d9cb-cc8cn"] Jun 09 22:03:13.467578 ip-10-0-128-8 kubenswrapper[2579]: W0609 22:03:13.467544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403d8f9e_8b32_4d9f_9472_ad08da6b3847.slice/crio-8633ab783a5b65fc6638e38b35764310b355584545b7e2adb23c21dd94e9eb59 WatchSource:0}: Error finding container 8633ab783a5b65fc6638e38b35764310b355584545b7e2adb23c21dd94e9eb59: Status 404 returned error can't find the container with id 8633ab783a5b65fc6638e38b35764310b355584545b7e2adb23c21dd94e9eb59 Jun 09 22:03:13.468892 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:13.468876 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 22:03:14.252440 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:14.252355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" event={"ID":"403d8f9e-8b32-4d9f-9472-ad08da6b3847","Type":"ContainerStarted","Data":"5cdc8c1c9d09e5c063fbbd5e7d8457c7aff3d1e46d939904328bda01f92880f0"} Jun 09 22:03:14.252440 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:14.252410 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:03:14.252440 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:14.252427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" event={"ID":"403d8f9e-8b32-4d9f-9472-ad08da6b3847","Type":"ContainerStarted","Data":"8633ab783a5b65fc6638e38b35764310b355584545b7e2adb23c21dd94e9eb59"} Jun 09 22:03:14.272317 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:14.272257 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" podStartSLOduration=1.814822444 podStartE2EDuration="2.272241177s" totalImagesPullingTime="457.418733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:03:14.269280698 +0000 UTC m=+1082.236749536" watchObservedRunningTime="2026-06-09 22:03:14.272241177 +0000 UTC m=+1082.239710018" Jun 09 22:03:25.263556 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:03:25.263517 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db556d9cb-cc8cn" Jun 09 22:05:12.541895 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:05:12.541867 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:05:12.545035 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:05:12.545011 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:05:12.550118 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:05:12.550098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:05:12.553007 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:05:12.552991 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:10:12.576551 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:10:12.576521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:10:12.580461 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:10:12.580441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:10:12.584363 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:10:12.584344 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:10:12.587994 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:10:12.587976 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:13:35.007595 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.007559 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 22:13:35.008140 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.007780 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" podUID="245dcc2b-9834-47a8-b086-1dd8f51a3749" containerName="manager" containerID="cri-o://9fabb3c19bb4ac06010eb0c19e6dfca8f6e1c8029b37825d774b92720e49ef97" gracePeriod=10 Jun 09 22:13:35.259613 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.259558 2579 generic.go:356] "Generic (PLEG): container finished" podID="245dcc2b-9834-47a8-b086-1dd8f51a3749" containerID="9fabb3c19bb4ac06010eb0c19e6dfca8f6e1c8029b37825d774b92720e49ef97" exitCode=0 Jun 09 22:13:35.259742 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.259629 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" event={"ID":"245dcc2b-9834-47a8-b086-1dd8f51a3749","Type":"ContainerDied","Data":"9fabb3c19bb4ac06010eb0c19e6dfca8f6e1c8029b37825d774b92720e49ef97"} Jun 09 22:13:35.259742 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.259706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" event={"ID":"245dcc2b-9834-47a8-b086-1dd8f51a3749","Type":"ContainerDied","Data":"2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7"} Jun 09 22:13:35.259742 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.259725 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b170780777cda2aed7678afa1836ce41b86acd6f36da65d888e4c8a0c085ad7" Jun 09 22:13:35.261589 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.261569 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 22:13:35.343381 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.343349 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jps9z\" (UniqueName: \"kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z\") pod \"245dcc2b-9834-47a8-b086-1dd8f51a3749\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " Jun 09 22:13:35.343556 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.343392 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume\") pod \"245dcc2b-9834-47a8-b086-1dd8f51a3749\" (UID: \"245dcc2b-9834-47a8-b086-1dd8f51a3749\") " Jun 09 22:13:35.343798 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.343776 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "245dcc2b-9834-47a8-b086-1dd8f51a3749" (UID: "245dcc2b-9834-47a8-b086-1dd8f51a3749"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:13:35.345500 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.345477 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z" (OuterVolumeSpecName: "kube-api-access-jps9z") pod "245dcc2b-9834-47a8-b086-1dd8f51a3749" (UID: "245dcc2b-9834-47a8-b086-1dd8f51a3749"). InnerVolumeSpecName "kube-api-access-jps9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:13:35.444104 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.444074 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jps9z\" (UniqueName: \"kubernetes.io/projected/245dcc2b-9834-47a8-b086-1dd8f51a3749-kube-api-access-jps9z\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:13:35.444104 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:35.444098 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/245dcc2b-9834-47a8-b086-1dd8f51a3749-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\"" Jun 09 22:13:36.264416 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:36.264377 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x" Jun 09 22:13:36.284723 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:36.284698 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 22:13:36.287623 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:36.287599 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfn6x"] Jun 09 22:13:36.514601 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:13:36.514521 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245dcc2b-9834-47a8-b086-1dd8f51a3749" path="/var/lib/kubelet/pods/245dcc2b-9834-47a8-b086-1dd8f51a3749/volumes" Jun 09 22:14:12.676804 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:12.676777 2579 scope.go:117] "RemoveContainer" containerID="9fabb3c19bb4ac06010eb0c19e6dfca8f6e1c8029b37825d774b92720e49ef97" Jun 09 22:14:41.106976 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.106943 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl"] Jun 09 22:14:41.107430 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.107349 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245dcc2b-9834-47a8-b086-1dd8f51a3749" containerName="manager" Jun 09 22:14:41.107430 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.107361 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="245dcc2b-9834-47a8-b086-1dd8f51a3749" containerName="manager" Jun 09 22:14:41.107547 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.107437 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="245dcc2b-9834-47a8-b086-1dd8f51a3749" containerName="manager" Jun 09 22:14:41.110433 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.110417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.112780 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.112755 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h86d7\"" Jun 09 22:14:41.123509 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.123488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl"] Jun 09 22:14:41.227623 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.227594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/303dd00f-8d69-4f14-a98d-7a605e746c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.227773 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.227633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbtmg\" (UniqueName: \"kubernetes.io/projected/303dd00f-8d69-4f14-a98d-7a605e746c13-kube-api-access-vbtmg\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.328518 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.328488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/303dd00f-8d69-4f14-a98d-7a605e746c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.328684 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.328525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbtmg\" (UniqueName: \"kubernetes.io/projected/303dd00f-8d69-4f14-a98d-7a605e746c13-kube-api-access-vbtmg\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.328959 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.328935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/303dd00f-8d69-4f14-a98d-7a605e746c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.337479 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.337451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbtmg\" (UniqueName: \"kubernetes.io/projected/303dd00f-8d69-4f14-a98d-7a605e746c13-kube-api-access-vbtmg\") pod \"kuadrant-operator-controller-manager-86878c769f-pkwhl\" (UID: \"303dd00f-8d69-4f14-a98d-7a605e746c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.420680 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.420655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:41.563126 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:41.563100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl"] Jun 09 22:14:41.566187 ip-10-0-128-8 kubenswrapper[2579]: W0609 22:14:41.566153 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303dd00f_8d69_4f14_a98d_7a605e746c13.slice/crio-3caa0b191b436ee243ebdca6d3b2b2459e1da0040f7e1b0d9dc816d4587f27e5 WatchSource:0}: Error finding container 3caa0b191b436ee243ebdca6d3b2b2459e1da0040f7e1b0d9dc816d4587f27e5: Status 404 returned error can't find the container with id 3caa0b191b436ee243ebdca6d3b2b2459e1da0040f7e1b0d9dc816d4587f27e5 Jun 09 22:14:42.577555 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:42.577523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" event={"ID":"303dd00f-8d69-4f14-a98d-7a605e746c13","Type":"ContainerStarted","Data":"60f80588b0488deec78655c4719f56d1c6087b03f90f3bb4f444a82e260aca10"} Jun 09 22:14:42.577999 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:42.577574 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" event={"ID":"303dd00f-8d69-4f14-a98d-7a605e746c13","Type":"ContainerStarted","Data":"3caa0b191b436ee243ebdca6d3b2b2459e1da0040f7e1b0d9dc816d4587f27e5"} Jun 09 22:14:42.577999 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:42.577666 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:14:42.596946 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:42.596905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" podStartSLOduration=1.5968912849999999 podStartE2EDuration="1.596891285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:14:42.594529622 +0000 UTC m=+1770.561998465" watchObservedRunningTime="2026-06-09 22:14:42.596891285 +0000 UTC m=+1770.564360126" Jun 09 22:14:53.584952 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:14:53.584920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkwhl" Jun 09 22:15:12.606985 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:15:12.606886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:15:12.614855 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:15:12.613220 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:15:12.615152 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:15:12.615137 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:15:12.621438 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:15:12.621421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:20:12.641492 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:20:12.641464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:20:12.647946 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:20:12.647915 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:20:12.649608 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:20:12.649588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:20:12.656101 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:20:12.656083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:24:36.941964 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:36.941936 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685f4c745c-zr6vl_54f937ab-a9fa-4039-a361-e9d4fc09a8c1/authorino/0.log" Jun 09 22:24:41.690723 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:41.690693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6ffc599675-wnw5x_5b06ce78-8a40-4d44-94cc-2ce5b2912eef/maas-api/0.log" Jun 09 22:24:42.020125 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:42.020057 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db556d9cb-cc8cn_403d8f9e-8b32-4d9f-9472-ad08da6b3847/manager/0.log" Jun 09 22:24:42.590158 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:42.590127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-rf9w8_2d2fa1cd-827c-4df6-abe6-72a316c32c3d/manager/0.log" Jun 09 22:24:42.597136 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:42.597112 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-rf9w8_2d2fa1cd-827c-4df6-abe6-72a316c32c3d/copy-manifests/0.log" Jun 09 22:24:43.901916 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:43.901885 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685f4c745c-zr6vl_54f937ab-a9fa-4039-a361-e9d4fc09a8c1/authorino/0.log" Jun 09 22:24:44.126742 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:44.126711 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7rdmm_b00ccbff-bfef-41e8-adff-034864baa42e/manager/0.log" Jun 09 22:24:44.454405 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:44.454378 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pkwhl_303dd00f-8d69-4f14-a98d-7a605e746c13/manager/0.log" Jun 09 22:24:45.232661 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:45.232622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-l2st6_3c274e88-dd74-4286-b0cf-ecc820085234/kube-auth-proxy/0.log" Jun 09 22:24:45.774161 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:45.774134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 22:24:46.338051 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:46.338027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84_41827891-d288-4394-be11-246c0843f5ab/storage-initializer/0.log" Jun 09 22:24:46.343909 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:46.343889 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ltx84_41827891-d288-4394-be11-246c0843f5ab/main/0.log" Jun 09 22:24:46.572002 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:46.571975 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv_e8e2178a-e10d-4f90-8853-dc22f18b9d4d/storage-initializer/0.log" Jun 09 22:24:46.577903 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:46.577882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8d9tv_e8e2178a-e10d-4f90-8853-dc22f18b9d4d/main/0.log" Jun 09 22:24:53.676426 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:53.676394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p9trq_910e37f7-df05-4e18-8285-09adbbdd4f6d/global-pull-secret-syncer/0.log" Jun 09 22:24:53.749302 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:53.749279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nv7jx_535da9eb-43f1-43da-8eb6-2db84264c3a0/konnectivity-agent/0.log" Jun 09 22:24:53.800744 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:53.800721 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-8.ec2.internal_175385351a4a50e51d389f09a322c4dd/haproxy/0.log" Jun 09 22:24:58.418031 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:58.417990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685f4c745c-zr6vl_54f937ab-a9fa-4039-a361-e9d4fc09a8c1/authorino/0.log" Jun 09 22:24:58.615621 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:58.615593 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7rdmm_b00ccbff-bfef-41e8-adff-034864baa42e/manager/0.log" Jun 09 22:24:58.761689 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:24:58.761593 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pkwhl_303dd00f-8d69-4f14-a98d-7a605e746c13/manager/0.log" Jun 09 22:25:00.776587 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:00.776561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-d7slq_92724e1f-bee6-4b01-a17f-ef6ad42dad4f/cluster-monitoring-operator/0.log" Jun 09 22:25:00.888155 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:00.888129 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-7znlq_e6f451cc-e35f-4672-ad99-c6bfc3a67473/monitoring-plugin/0.log" Jun 09 22:25:00.915807 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:00.915784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/node-exporter/0.log" Jun 09 22:25:00.934351 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:00.934331 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/kube-rbac-proxy/0.log" Jun 09 22:25:00.955384 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:00.955328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67nqm_69c24e4f-5d9e-4430-be91-8fe3012ce3f0/init-textfile/0.log" Jun 09 22:25:01.153944 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.153911 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/kube-rbac-proxy-main/0.log" Jun 09 22:25:01.176491 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.176473 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/kube-rbac-proxy-self/0.log" Jun 09 22:25:01.201494 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.201477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-w8ts9_9b0ef58b-1d1e-4b94-8156-3035da1d73f6/openshift-state-metrics/0.log" Jun 09 22:25:01.242098 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.242045 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/prometheus/0.log" Jun 09 22:25:01.266014 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.265996 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/config-reloader/0.log" Jun 09 22:25:01.286312 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.286293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/thanos-sidecar/0.log" Jun 09 22:25:01.309024 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.309007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy-web/0.log" Jun 09 22:25:01.329868 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.329844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy/0.log" Jun 09 22:25:01.352808 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.352786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/kube-rbac-proxy-thanos/0.log" Jun 09 22:25:01.372828 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.372807 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d12f1462-63d3-4481-8e44-5fc9aa641180/init-config-reloader/0.log" Jun 09 22:25:01.401812 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.401793 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-s28tg_c9d23452-b4f3-41d2-8a1a-368d394a5717/prometheus-operator/0.log" Jun 09 22:25:01.420205 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.420188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-s28tg_c9d23452-b4f3-41d2-8a1a-368d394a5717/kube-rbac-proxy/0.log" Jun 09 22:25:01.445631 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:01.445608 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-rmc4t_7f11ce06-9742-40d3-a2d6-2f54f51a38ba/prometheus-operator-admission-webhook/0.log" Jun 09 22:25:03.869451 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:03.869419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:25:03.874883 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:03.874860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/2.log" Jun 09 22:25:05.179928 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.179890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hmw6g_4080b5c8-5fe4-4724-94ab-6b0a65e3fc46/volume-data-source-validator/0.log" Jun 09 22:25:05.950831 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.950793 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p"] Jun 09 22:25:05.954327 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.954303 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:05.956669 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.956620 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcwh\"/\"openshift-service-ca.crt\"" Jun 09 22:25:05.956772 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.956621 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfcwh\"/\"default-dockercfg-s5h6z\"" Jun 09 22:25:05.957582 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.957563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcwh\"/\"kube-root-ca.crt\"" Jun 09 22:25:05.962363 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:05.962341 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p"] Jun 09 22:25:06.034166 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.034142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfd8z\" (UniqueName: \"kubernetes.io/projected/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-kube-api-access-hfd8z\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.034273 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.034186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-lib-modules\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.034273 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.034242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-podres\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.034355 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.034276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-proc\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.034355 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.034324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-sys\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.134935 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.134902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfd8z\" (UniqueName: \"kubernetes.io/projected/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-kube-api-access-hfd8z\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135038 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.134955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-lib-modules\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135038 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.134982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-podres\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135038 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.134999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-proc\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135038 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.135022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-sys\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135231 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.135112 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-proc\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135231 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.135124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-sys\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135231 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.135137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-podres\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.135231 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.135171 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-lib-modules\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.141872 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.141852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfd8z\" (UniqueName: \"kubernetes.io/projected/cb21fd4c-4f51-4f87-b1d3-e6131fe06a54-kube-api-access-hfd8z\") pod \"perf-node-gather-daemonset-6296p\" (UID: \"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.264774 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.264702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.391532 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.391506 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p"] Jun 09 22:25:06.393565 ip-10-0-128-8 kubenswrapper[2579]: W0609 22:25:06.393538 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb21fd4c_4f51_4f87_b1d3_e6131fe06a54.slice/crio-be9c23646f64389a6356859a7a2d75c884bae8b9f6ffa2a148766b09c278218b WatchSource:0}: Error finding container be9c23646f64389a6356859a7a2d75c884bae8b9f6ffa2a148766b09c278218b: Status 404 returned error can't find the container with id be9c23646f64389a6356859a7a2d75c884bae8b9f6ffa2a148766b09c278218b Jun 09 22:25:06.414500 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.414482 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsrx4_c2b24534-d98f-4c43-8745-9eed725d9bef/dns/0.log" Jun 09 22:25:06.435755 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.435737 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsrx4_c2b24534-d98f-4c43-8745-9eed725d9bef/kube-rbac-proxy/0.log" Jun 09 22:25:06.549202 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.549124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" event={"ID":"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54","Type":"ContainerStarted","Data":"6ebf0d4700b3adfc95002d8f3d409f5c7a753d5edc289139c07a99b474cc6120"} Jun 09 22:25:06.549202 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.549177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" event={"ID":"cb21fd4c-4f51-4f87-b1d3-e6131fe06a54","Type":"ContainerStarted","Data":"be9c23646f64389a6356859a7a2d75c884bae8b9f6ffa2a148766b09c278218b"} Jun 09 22:25:06.549368 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.549324 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:06.568676 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.568604 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" podStartSLOduration=1.5685864299999999 podStartE2EDuration="1.56858643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 22:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:25:06.565218408 +0000 UTC m=+2394.532687245" watchObservedRunningTime="2026-06-09 22:25:06.56858643 +0000 UTC m=+2394.536055271" Jun 09 22:25:06.578547 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:06.578527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8kfpb_8d7a06ef-dead-4d46-a19a-2ab0f4fe776a/dns-node-resolver/0.log" Jun 09 22:25:07.150357 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:07.150321 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xv7h_2e3b8a04-a12a-47c4-a6a4-cf23e2e8af8c/node-ca/0.log" Jun 09 22:25:08.180341 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:08.180316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-l2st6_3c274e88-dd74-4286-b0cf-ecc820085234/kube-auth-proxy/0.log" Jun 09 22:25:08.400087 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:08.400061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 22:25:09.013753 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.013711 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxml9_0497a465-bc63-4882-9fd5-9270917d73e4/serve-healthcheck-canary/0.log" Jun 09 22:25:09.513274 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.513249 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ch7hk_3cf1bda3-8126-41f0-a126-470f335894c5/insights-operator/0.log" Jun 09 22:25:09.515414 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.515394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ch7hk_3cf1bda3-8126-41f0-a126-470f335894c5/insights-operator/1.log" Jun 09 22:25:09.595173 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.595123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdpwc_d547ecf1-6d5e-4293-b911-a8c7bda13b41/kube-rbac-proxy/0.log" Jun 09 22:25:09.614847 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.614824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdpwc_d547ecf1-6d5e-4293-b911-a8c7bda13b41/exporter/0.log" Jun 09 22:25:09.633898 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:09.633870 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdpwc_d547ecf1-6d5e-4293-b911-a8c7bda13b41/extractor/0.log" Jun 09 22:25:12.100528 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.100498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6ffc599675-wnw5x_5b06ce78-8a40-4d44-94cc-2ce5b2912eef/maas-api/0.log" Jun 09 22:25:12.214520 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.214489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db556d9cb-cc8cn_403d8f9e-8b32-4d9f-9472-ad08da6b3847/manager/0.log" Jun 09 22:25:12.501277 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.501249 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-rf9w8_2d2fa1cd-827c-4df6-abe6-72a316c32c3d/manager/0.log" Jun 09 22:25:12.523408 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.523382 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-rf9w8_2d2fa1cd-827c-4df6-abe6-72a316c32c3d/copy-manifests/0.log" Jun 09 22:25:12.564759 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.564733 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-6296p" Jun 09 22:25:12.674053 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.673954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:25:12.691699 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.681837 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nvfr7_f5f459db-f226-4192-ba63-9768de9fc9d3/console-operator/1.log" Jun 09 22:25:12.691699 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.682272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:25:12.691699 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:12.689333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:25:14.061967 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:14.061943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9d96bd75-rj9m6_28997144-f467-4e52-bd57-05f248283752/manager/0.log" Jun 09 22:25:18.831094 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:18.831019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-l2st6_3c274e88-dd74-4286-b0cf-ecc820085234/kube-auth-proxy/0.log" Jun 09 22:25:19.017178 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:19.017148 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 22:25:20.157831 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:20.157799 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-l2st6_3c274e88-dd74-4286-b0cf-ecc820085234/kube-auth-proxy/0.log" Jun 09 22:25:20.351235 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:20.351201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 22:25:21.176545 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.176518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/kube-multus-additional-cni-plugins/0.log" Jun 09 22:25:21.195516 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.195497 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/egress-router-binary-copy/0.log" Jun 09 22:25:21.215223 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.215204 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/cni-plugins/0.log" Jun 09 22:25:21.234469 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.234447 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/bond-cni-plugin/0.log" Jun 09 22:25:21.253976 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.253954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/routeoverride-cni/0.log" Jun 09 22:25:21.273112 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.273094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/whereabouts-cni-bincopy/0.log" Jun 09 22:25:21.291219 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.291200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fp2p_f678a0aa-a46e-485e-9619-6ddb3daa165a/whereabouts-cni/0.log" Jun 09 22:25:21.490160 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.490091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lcnzh_c948b9e9-afc9-429f-8395-adb71dae3bb4/kube-multus/0.log" Jun 09 22:25:21.629564 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.629533 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh85r_c0b62fe1-e6b6-4520-ac7f-6e8dd510043b/network-metrics-daemon/0.log" Jun 09 22:25:21.648134 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.648111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh85r_c0b62fe1-e6b6-4520-ac7f-6e8dd510043b/kube-rbac-proxy/0.log" Jun 09 22:25:21.984691 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:21.984658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-l2st6_3c274e88-dd74-4286-b0cf-ecc820085234/kube-auth-proxy/0.log" Jun 09 22:25:22.153936 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:22.153909 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b69874c99-h8zl2_102cd2c8-3616-4b1d-ab8a-af2bfd23fbdd/router/0.log" Jun 09 22:25:22.979638 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:22.979611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-controller/0.log" Jun 09 22:25:22.995693 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:22.995666 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/0.log" Jun 09 22:25:22.995837 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:22.995790 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovn-acl-logging/1.log" Jun 09 22:25:23.014082 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.014061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/kube-rbac-proxy-node/0.log" Jun 09 22:25:23.033267 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.033249 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 22:25:23.048287 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.048270 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/northd/0.log" Jun 09 22:25:23.066362 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.066346 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/nbdb/0.log" Jun 09 22:25:23.085592 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.085577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/sbdb/0.log" Jun 09 22:25:23.133058 ip-10-0-128-8 kubenswrapper[2579]: I0609 22:25:23.133035 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5trw_e06adfab-9d53-4e01-b9e8-0b2220ad7de5/ovnkube-controller/0.log"