Jul 06 18:19:25.822944 ip-10-0-132-134 systemd[1]: Starting Kubernetes Kubelet... Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.139025 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143127 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143143 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143148 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143151 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143154 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143158 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143161 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.177939 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143163 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143166 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143169 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143173 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143177 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143181 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143183 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143186 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143190 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143193 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143198 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143201 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143203 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143206 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143208 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143211 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143213 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143216 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143219 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.181365 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143221 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143228 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143230 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143233 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143236 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143240 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143244 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143247 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143250 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143253 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143256 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143258 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143261 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143263 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143266 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143269 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143271 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143274 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143276 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.182190 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143280 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143283 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143285 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143288 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143291 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143294 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143298 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143301 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143304 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143307 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143310 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143313 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143316 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143319 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143321 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143324 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143327 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143332 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143336 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.184809 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143339 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143342 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143345 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143347 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143350 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143353 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143356 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143388 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143392 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143395 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143398 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143401 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143404 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143406 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143409 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143412 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143414 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143417 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143420 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143423 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.185722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143425 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143428 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143430 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143432 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143435 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143438 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143441 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143443 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143445 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143448 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143450 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143453 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143456 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.143458 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144188 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144195 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144198 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144200 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144203 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144206 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.187432 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144209 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144212 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144215 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144217 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144220 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144222 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144225 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144227 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144231 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144234 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144236 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144239 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144242 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144246 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144250 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144253 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144258 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144261 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144264 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.188221 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144267 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144270 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144272 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144275 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144278 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144281 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144284 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144287 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144291 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144295 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144298 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144301 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144303 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144308 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144311 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144314 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144317 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144319 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144322 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.189061 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144324 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144327 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144330 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144332 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144335 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144338 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144341 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144343 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144346 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144348 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144351 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144354 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144356 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144359 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144361 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144364 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144366 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144369 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144372 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144374 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.189872 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144377 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144379 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144382 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144384 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144387 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144390 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144394 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144396 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144399 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144401 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144404 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144407 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144409 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144412 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144414 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144417 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144419 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144422 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144426 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144428 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.190675 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144433 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144436 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144439 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144441 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144444 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144448 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144450 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144453 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144455 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144458 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144460 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144463 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144465 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144468 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144470 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144865 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144870 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144873 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144877 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144880 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.192756 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144883 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144885 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144888 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144891 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144893 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144896 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144899 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144901 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144904 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144907 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144909 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144917 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144921 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144924 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144930 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144933 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144936 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.194064 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144938 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144941 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144943 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144946 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144948 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144951 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144953 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144956 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144958 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144961 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144963 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144968 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144971 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144973 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144976 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144978 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144981 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144983 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144986 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144988 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.194970 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144993 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144995 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.144998 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145001 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145003 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145007 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145009 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145012 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145014 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145018 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145020 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145023 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145025 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145028 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145030 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145033 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145035 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145038 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145040 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145043 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.195841 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145045 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145048 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145050 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145055 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145058 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145061 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145066 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145069 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145072 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145075 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145078 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145081 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145083 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145086 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145088 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145091 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145094 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145096 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145099 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.198037 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145102 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145104 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145107 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145109 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145112 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145114 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145117 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145121 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145123 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145126 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145128 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145131 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145133 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145135 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145138 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145140 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145217 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145235 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145242 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145247 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145251 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 18:19:26.198933 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145254 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145258 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145263 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145266 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145269 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145273 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145276 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145279 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145282 2574 flags.go:64] FLAG: --cgroup-root="" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145285 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145288 2574 flags.go:64] FLAG: --client-ca-file="" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145292 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145295 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145300 2574 flags.go:64] FLAG: --cluster-domain="" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145303 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145306 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145309 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145313 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145317 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145321 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145324 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145328 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145331 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145335 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 18:19:26.201083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145338 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145341 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145344 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145350 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145353 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145356 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145360 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145363 2574 flags.go:64] FLAG: --enable-server="true" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145366 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145371 2574 flags.go:64] FLAG: --event-burst="100" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145374 2574 flags.go:64] FLAG: --event-qps="50" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145377 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145380 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145383 2574 flags.go:64] FLAG: --eviction-hard="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145387 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145390 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145393 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145396 2574 flags.go:64] FLAG: --eviction-soft="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145401 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145404 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145408 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145411 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145414 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145417 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145420 2574 flags.go:64] FLAG: --feature-gates="" Jul 06 18:19:26.201957 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145423 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145426 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145429 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145433 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145436 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145439 2574 flags.go:64] FLAG: --help="false" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145442 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-132-134.ec2.internal" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145445 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145448 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145451 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145455 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145459 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145462 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145465 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145468 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145470 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145473 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145477 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145480 2574 flags.go:64] FLAG: --kube-reserved="" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145483 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145486 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145489 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145491 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145494 2574 flags.go:64] FLAG: --lock-file="" Jul 06 18:19:26.204131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145497 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145502 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145505 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145510 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145514 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145517 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145520 2574 flags.go:64] FLAG: --logging-format="text" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145522 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145526 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145529 2574 flags.go:64] FLAG: --manifest-url="" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145531 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145536 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145539 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145543 2574 flags.go:64] FLAG: --max-pods="110" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145546 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145549 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145552 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145555 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145560 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145563 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145566 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145572 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145576 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145579 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 18:19:26.204982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145582 2574 flags.go:64] FLAG: --pod-cidr="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145585 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145590 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145593 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145596 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145599 2574 flags.go:64] FLAG: --port="10250" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145602 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145605 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02206ffe7449bd897" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145609 2574 flags.go:64] FLAG: --qos-reserved="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145613 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145616 2574 flags.go:64] FLAG: --register-node="true" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145619 2574 flags.go:64] FLAG: --register-with-taints="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145623 2574 flags.go:64] FLAG: --registry-burst="10" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145629 2574 flags.go:64] FLAG: --registry-qps="5" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145632 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145635 2574 flags.go:64] FLAG: --reserved-memory="" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145638 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145642 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145645 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145648 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145650 2574 flags.go:64] FLAG: --runonce="false" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145653 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145656 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145659 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145662 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 18:19:26.207209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145665 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145668 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145672 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145676 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145679 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145682 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145685 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145687 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145690 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145694 2574 flags.go:64] FLAG: --system-cgroups="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145697 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145702 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145705 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145708 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145713 2574 flags.go:64] FLAG: --tls-min-version="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145716 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145720 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145723 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145726 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145729 2574 flags.go:64] FLAG: --v="2" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145733 2574 flags.go:64] FLAG: --version="false" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145738 2574 flags.go:64] FLAG: --vmodule="" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145742 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.145745 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145879 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.208100 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145884 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145887 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145890 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145893 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145896 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145898 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145901 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145903 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145906 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145910 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145914 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145918 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145920 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145923 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145926 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145928 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145931 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145934 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145936 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145939 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.210319 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145941 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145944 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145946 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145950 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145953 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145955 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145958 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145961 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145964 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145967 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145969 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145972 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145975 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145977 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145980 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145983 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145985 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145988 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145990 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145993 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.315407 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145995 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.145999 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146002 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146005 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146007 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146010 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146012 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146015 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146017 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146020 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146023 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146025 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146028 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146030 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146032 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146036 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146039 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146042 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146044 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146047 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.318294 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146049 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146052 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146055 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146058 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146060 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146064 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146068 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146071 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146074 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146076 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146079 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146082 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146084 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146089 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146091 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146094 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146097 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146100 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146102 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.319159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146105 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146108 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146111 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146114 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146116 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146119 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146123 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146126 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146130 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146133 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146136 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146138 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146141 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146144 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146147 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146150 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146153 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146156 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.320016 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.146158 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.146712 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155179 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155203 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155224 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155230 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155288 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155293 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155296 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155299 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155302 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155305 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155307 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155310 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155312 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.320908 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155315 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155317 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155320 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155323 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155326 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155330 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155334 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155337 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155340 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155342 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155346 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155349 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155351 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155354 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155357 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155360 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155363 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155366 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155369 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.322629 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155372 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155374 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155377 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155380 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155383 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155385 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155388 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155391 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155394 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155396 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155399 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155402 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155404 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155406 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155409 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155412 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155414 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155417 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155420 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155423 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.323503 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155425 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155428 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155431 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155434 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155436 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155439 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155442 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155446 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155449 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155452 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155456 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155458 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155461 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155463 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155466 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155468 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155471 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155474 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155477 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.325228 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155479 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155482 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155485 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155487 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155490 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155492 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155495 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155497 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155500 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155503 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155505 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155508 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155511 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155513 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155516 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155519 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155521 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155524 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155528 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155531 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.326483 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155534 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155537 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155540 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155544 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155547 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155549 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155552 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155555 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155557 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155560 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155562 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155565 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155570 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155687 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155692 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 18:19:26.328680 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155695 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155698 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155701 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155704 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155706 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155709 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155711 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155714 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155716 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155719 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155722 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155725 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155730 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155733 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155736 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155738 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155741 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155743 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155749 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155751 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 18:19:26.329536 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155754 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155756 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155759 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155761 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155764 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155767 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155769 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155772 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155775 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155777 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155780 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155782 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155801 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155805 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155808 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155810 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155813 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155815 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155818 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 18:19:26.331291 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155822 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155826 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155829 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155832 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155835 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155841 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155843 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155846 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155848 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155851 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155854 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155858 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155860 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155863 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155865 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155868 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155871 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155873 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155876 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155878 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 18:19:26.332169 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155881 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155884 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155887 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155889 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155892 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155895 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155897 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155900 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155903 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155905 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155908 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155910 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155915 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155918 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155922 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155925 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155930 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155933 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 18:19:26.333934 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155935 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155938 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155941 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155944 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155948 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155951 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155954 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155957 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155959 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155962 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155964 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155967 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155969 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155972 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155974 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155977 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155981 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155984 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 18:19:26.334777 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:26.155987 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.155992 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.156120 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.158223 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.159447 2574 server.go:1019] "Starting client certificate rotation" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.159546 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.160164 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.161930 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.164436 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.177317 2574 log.go:25] "Validated CRI v1 runtime API" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.180440 2574 log.go:25] "Validated CRI v1 image API" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.181296 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 18:19:26.336100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.183398 2574 fs.go:135] Filesystem UUIDs: map[04273262-8499-4e47-a84f-6e4063a4882a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f0dd20eb-2df5-406e-a529-b2f1331bf146:/dev/nvme0n1p4] Jul 06 18:19:26.336525 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.183413 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 18:19:26.336525 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.189063 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.190226 2574 manager.go:216] Machine: {Timestamp:2026-07-06 18:19:26.18895784 +0000 UTC m=+0.267033789 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105526 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e523141b36ef0b932f14cf18bb3c SystemUUID:ec20e523-141b-36ef-0b93-2f14cf18bb3c BootID:7a96ec69-49c1-415a-8114-6fa2dec83587 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:55:3c:a6:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:55:3c:a6:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:5f:13:4e:7e:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.190333 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.190469 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.193146 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.193187 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.193941 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.193954 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.193963 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.194522 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.195852 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.243313 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bqlj" Jul 06 18:19:26.337403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:26.251649 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bqlj" Jul 06 18:19:27.137517 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137459 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 06 18:19:27.137650 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137638 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 18:19:27.137697 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137678 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 06 18:19:27.137697 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137689 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 18:19:27.137767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137707 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 18:19:27.137767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137717 2574 kubelet.go:398] "Adding apiserver pod source" Jul 06 18:19:27.137767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.137729 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 18:19:27.138237 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.138221 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 18:19:27.138295 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.138247 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 18:19:27.140395 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.140372 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 18:19:27.142607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.142584 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 18:19:27.142675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.142639 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 18:19:27.143783 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143770 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143787 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143794 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143799 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143815 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143821 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143830 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143835 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 18:19:27.143840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143843 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 18:19:27.144089 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143850 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 18:19:27.144089 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143895 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 18:19:27.144089 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.143907 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 18:19:27.145365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.145352 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 18:19:27.145365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.145364 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 18:19:27.148781 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.148761 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:27.149486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.149466 2574 server.go:1268] "Started kubelet" Jul 06 18:19:27.149585 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.149541 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 18:19:27.149679 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.149603 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 18:19:27.149793 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.149701 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 18:19:27.150502 ip-10-0-132-134 systemd[1]: Started Kubernetes Kubelet. Jul 06 18:19:27.152426 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.152261 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-134.ec2.internal" not found Jul 06 18:19:27.152426 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.152392 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 06 18:19:27.152596 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.152466 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:27.153993 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.153975 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 18:19:27.158400 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.157225 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 18:19:27.158762 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.158745 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 18:19:27.158929 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.158907 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 18:19:27.158981 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.158925 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 18:19:27.159770 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.158942 2574 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://aec81392bdba44bd1ab8512d22883f90-ac231e70f00c7a02.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events\": read tcp 10.0.132.134:60408->100.51.123.22:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-132-134.ec2.internal.18bfc642ade206eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-134.ec2.internal,UID:ip-10-0-132-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-134.ec2.internal,},FirstTimestamp:2026-07-06 18:19:27.149418219 +0000 UTC m=+1.227494149,LastTimestamp:2026-07-06 18:19:27.149418219 +0000 UTC m=+1.227494149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-134.ec2.internal,}" Jul 06 18:19:27.161272 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.161254 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 18:19:27.161333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.161261 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 18:19:27.161440 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.161389 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.162071 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162049 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 18:19:27.162151 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162090 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 18:19:27.162151 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162076 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 18:19:27.162264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162200 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 06 18:19:27.162264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162208 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 06 18:19:27.162714 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162687 2574 factory.go:153] Registering CRI-O factory Jul 06 18:19:27.162714 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162708 2574 factory.go:223] Registration of the crio container factory successfully Jul 06 18:19:27.162871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162764 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 18:19:27.162871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162775 2574 factory.go:55] Registering systemd factory Jul 06 18:19:27.162871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162783 2574 factory.go:223] Registration of the systemd container factory successfully Jul 06 18:19:27.162871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162826 2574 factory.go:103] Registering Raw factory Jul 06 18:19:27.162871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.162841 2574 manager.go:1196] Started watching for new ooms in manager Jul 06 18:19:27.163456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.163440 2574 manager.go:349] Starting recovery of all containers Jul 06 18:19:27.175190 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.175153 2574 manager.go:354] Recovery completed Jul 06 18:19:27.176535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.176519 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:27.180061 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.179934 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.181975 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.181944 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.182067 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.181983 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.182067 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.181996 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.182655 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.182632 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 18:19:27.182655 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.182652 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 18:19:27.182796 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.182678 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 06 18:19:27.182796 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.182680 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.185237 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185092 2574 policy_none.go:49] "None policy: Start" Jul 06 18:19:27.185281 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185244 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 18:19:27.185281 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185261 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 18:19:27.185587 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185572 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.185635 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185600 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.185635 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.185612 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.187295 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.187283 2574 policy_none.go:47] "Start" Jul 06 18:19:27.188716 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.188698 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-134.ec2.internal\" not found" node="ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.195738 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.195720 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-134.ec2.internal" not found Jul 06 18:19:27.224574 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.224556 2574 manager.go:337] "Starting Device Plugin manager" Jul 06 18:19:27.224659 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.224604 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 18:19:27.224659 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.224625 2574 server.go:87] "Starting device plugin registration server" Jul 06 18:19:27.225044 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.225029 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 18:19:27.225091 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.225046 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 18:19:27.225278 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.225261 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 18:19:27.225370 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.225356 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 18:19:27.225429 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.225371 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 18:19:27.226094 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.226069 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 18:19:27.226715 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.226471 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.254338 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.254305 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-134.ec2.internal" not found Jul 06 18:19:27.304559 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.304509 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 18:19:27.306946 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.305839 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 18:19:27.306946 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.305912 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 18:19:27.306946 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.305942 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 18:19:27.306946 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.305981 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 18:19:27.309166 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.309144 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:27.325490 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.325455 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.326571 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.326539 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.326685 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.326577 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.326685 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.326594 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.326685 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.326624 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.334080 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.334061 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.334147 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.334089 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-134.ec2.internal\": node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.370808 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.370756 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.407198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.407125 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal"] Jul 06 18:19:27.407288 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.407227 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.409172 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.409155 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.409251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.409188 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.409251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.409198 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.411687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.411674 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.411814 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.411788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.411881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.411832 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.412584 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412565 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.412662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412593 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.412662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412603 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.412662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412569 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.412781 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412679 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.412781 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.412694 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.415091 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.415076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.415143 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.415110 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:27.416293 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.416277 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:27.416293 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.416305 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:27.416416 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.416320 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:27.438798 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.438771 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-134.ec2.internal\" not found" node="ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.443581 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.443563 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-134.ec2.internal\" not found" node="ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.464138 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.464107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9c1950d01285c941f9419cd08660742-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"d9c1950d01285c941f9419cd08660742\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.464251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.464149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.464251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.464172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.471334 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.471307 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.564687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9c1950d01285c941f9419cd08660742-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"d9c1950d01285c941f9419cd08660742\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.564687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.564908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.564908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9c1950d01285c941f9419cd08660742-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"d9c1950d01285c941f9419cd08660742\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.564908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.564908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.564838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c9ddef82fc9ee7511a5d22e04bc018-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"72c9ddef82fc9ee7511a5d22e04bc018\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.571970 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.571948 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.672343 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.672255 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.747187 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.747149 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.747285 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:27.747212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:27.773409 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.773377 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.873578 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.873528 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:27.974165 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:27.974078 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:28.075022 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.074988 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:28.138756 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.138715 2574 apiserver.go:52] "Watching apiserver" Jul 06 18:19:28.139001 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.138687 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 18:14:26 +0000 UTC" deadline="2028-03-13 01:35:20.658482442 +0000 UTC" Jul 06 18:19:28.139047 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.139008 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14767h15m52.519480989s" Jul 06 18:19:28.149701 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.149674 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 18:19:28.150084 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.150060 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-jr9zj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw","openshift-dns/node-resolver-fvxk2","openshift-image-registry/node-ca-8k9w4","openshift-multus/multus-additional-cni-plugins-p9gbv","openshift-multus/multus-kvpdg","openshift-multus/network-metrics-daemon-lk6bh","openshift-network-diagnostics/network-check-target-cs5mt","kube-system/global-pull-secret-syncer-tq2vs","openshift-cluster-node-tuning-operator/tuned-nxw9v","openshift-network-operator/iptables-alerter-xm7cm","openshift-ovn-kubernetes/ovnkube-node-96ghh"] Jul 06 18:19:28.150160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.150148 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.152408 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.152388 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.152510 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.152427 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.152510 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.152443 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.155356 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.155330 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.155443 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.155425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.155501 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.155472 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.157375 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157361 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.157375 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157369 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.157527 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157395 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.157527 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157411 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.157527 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157415 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.157527 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.157432 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.160247 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160231 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8trdc\"" Jul 06 18:19:28.160305 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160279 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 18:19:28.160305 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160291 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 18:19:28.160489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160474 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.160555 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.160608 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.160571 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.164179 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164164 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.164179 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164177 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.164353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164195 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.164353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164213 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.164353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164200 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.164353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.164307 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.166664 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166645 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.166732 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166718 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.166847 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166824 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.166973 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166879 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.166973 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166889 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 18:19:28.166973 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-krr5r\"" Jul 06 18:19:28.166973 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.166965 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.167828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167811 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.167924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167838 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.167924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167849 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.167924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167797 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.167924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167917 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.168053 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.167928 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.168943 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.168928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-sys-fs\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.168953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-tmp-dir\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.169002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.168973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a26d69c9-3ed0-4d2b-889d-3637029900d5-agent-certs\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.169002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.168997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-device-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcwq\" (UniqueName: \"kubernetes.io/projected/8cc00222-a6d3-473e-94ed-7145c2f0f053-kube-api-access-8bcwq\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169230 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-hosts-file\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.169230 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a26d69c9-3ed0-4d2b-889d-3637029900d5-konnectivity-ca\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.169230 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-socket-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169230 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-registration-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.169368 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.169231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vn6\" (UniqueName: \"kubernetes.io/projected/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-kube-api-access-x8vn6\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.170332 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170311 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.170435 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.170532 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170443 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.170532 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170449 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.170691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170538 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dc9vb\"" Jul 06 18:19:28.170691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.170578 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.171206 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171187 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.171298 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171219 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.171298 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171229 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.171298 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171187 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.171298 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171293 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.171441 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.171306 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.173557 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.173540 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 18:19:28.173915 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.173897 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.174018 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.173897 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.174086 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.174024 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cx6j6\"" Jul 06 18:19:28.174219 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.174203 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.174322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.174307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.174366 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.174337 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.175213 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.175063 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:28.176323 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176288 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.176323 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176316 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.176479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176328 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.176479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176344 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.176479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176362 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.176479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.176346 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.179201 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.179177 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.179308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.179260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.179308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.179284 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.179827 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.179774 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.180209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.179934 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 18:19:28.180209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180221 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180384 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180479 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180518 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vbtr4\"" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180549 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180564 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180526 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.180709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.180598 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.183012 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.182998 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 18:19:28.183060 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.183046 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jvj2d\"" Jul 06 18:19:28.183138 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.183123 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.183199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.183183 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.183255 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.183219 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.184037 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184019 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.184119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184048 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.184119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184059 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.184119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184020 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.184215 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.184115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:28.184215 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184129 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.184215 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.184145 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.186577 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.186563 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.186637 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.186614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:28.186637 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.186636 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.187353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187336 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.187456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187367 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.187456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187341 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.187456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187381 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.187456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187401 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.187456 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187413 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.187712 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.187464 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:28.187712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187545 2574 predicate.go:218] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-tq2vs" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jul 06 18:19:28.187712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187559 2574 allocation_manager.go:702] "Pod admission denied" podUID="753a3396-d9f1-4ebb-82a1-d3c9d6141cb4" pod="kube-system/global-pull-secret-syncer-tq2vs" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jul 06 18:19:28.187712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.187700 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.188405 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.188386 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.188493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.188414 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.188493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.188430 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.190847 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.190831 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.190949 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.190897 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.190949 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.190920 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.192368 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192349 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.192438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192373 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.192438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192390 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.192438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192395 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.192438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192407 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.192438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.192412 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.195002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.194984 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.195102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.195091 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.195167 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.195137 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.195439 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.195421 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.195504 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.195478 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.195547 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.195501 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v7rjh\"" Jul 06 18:19:28.196183 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196095 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.196183 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196141 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.196183 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196157 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.196384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196192 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.196384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196210 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.196384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.196221 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.198738 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.198711 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.198960 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.198946 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 18:19:28.199106 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.199092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9jnl\"" Jul 06 18:19:28.199169 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.199119 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.199497 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.199476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.199546 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.199515 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.200475 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.200460 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.200556 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.200490 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.200556 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.200513 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.203116 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.203087 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 18:19:28.204664 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204636 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 18:19:28.204664 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 18:19:28.204817 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204663 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 18:19:28.204817 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204643 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2r8cz\"" Jul 06 18:19:28.204817 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 18:19:28.204981 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.204842 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 18:19:28.263187 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.263160 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 18:19:28.269509 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-registration-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.269613 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-cnibin\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.269613 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms9rm\" (UniqueName: \"kubernetes.io/projected/b2ff7848-bd32-43d5-a0ab-53c117a23188-kube-api-access-ms9rm\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.269613 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-socket-dir-parent\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.269613 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-registration-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.269759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-system-cni-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.269759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-cnibin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.269759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-slash\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.269759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.269926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-bin\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.269926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a26d69c9-3ed0-4d2b-889d-3637029900d5-agent-certs\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.269926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.269926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ldd\" (UniqueName: \"kubernetes.io/projected/820edf78-8707-43e8-a69c-bdd9f411978f-kube-api-access-x6ldd\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.269926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-netns\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269951 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zczdp\" (UniqueName: \"kubernetes.io/projected/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-kube-api-access-zczdp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.269993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-netd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-run\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-hosts-file\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.270109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-os-release\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-hosts-file\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-multus-daemon-config\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-modprobe-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-host\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-kubernetes\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-conf\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a26d69c9-3ed0-4d2b-889d-3637029900d5-konnectivity-ca\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-socket-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vn6\" (UniqueName: \"kubernetes.io/projected/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-kube-api-access-x8vn6\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-socket-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysconfig\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270464 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7896522-4d08-4a54-a294-858f2db0b75b-ovn-node-metrics-cert\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-script-lib\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.270535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-kubelet\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-sys-fs\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-sys-fs\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-serviceca\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-multus\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rgd\" (UniqueName: \"kubernetes.io/projected/26f724e0-5994-4d1f-85c5-c8d0506ece4b-kube-api-access-64rgd\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-var-lib-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a26d69c9-3ed0-4d2b-889d-3637029900d5-konnectivity-ca\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270935 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-etc-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.270975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-ovn\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-log-socket\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-hostroot\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.271142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-tuned\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-host\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xgm8\" (UniqueName: \"kubernetes.io/projected/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-kube-api-access-8xgm8\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-tmp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-systemd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-system-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-k8s-cni-cncf-io\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-node-log\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-etc-kubernetes\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-conf-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271558 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-lib-modules\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26f724e0-5994-4d1f-85c5-c8d0506ece4b-iptables-alerter-script\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-device-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcwq\" (UniqueName: \"kubernetes.io/projected/8cc00222-a6d3-473e-94ed-7145c2f0f053-kube-api-access-8bcwq\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-os-release\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-bin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc00222-a6d3-473e-94ed-7145c2f0f053-device-dir\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-multus-certs\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8vk\" (UniqueName: \"kubernetes.io/projected/bd538408-bde8-40e2-8000-cff058c5cc52-kube-api-access-9x8vk\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271758 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-sys\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26f724e0-5994-4d1f-85c5-c8d0506ece4b-host-slash\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271869 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-systemd\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271899 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271870 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-var-lib-kubelet\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-netns\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271926 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271967 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.272851 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271981 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.271986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-env-overrides\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-tmp-dir\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-cni-binary-copy\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-config\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2ws\" (UniqueName: \"kubernetes.io/projected/d7896522-4d08-4a54-a294-858f2db0b75b-kube-api-access-4g2ws\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-systemd-units\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-kubelet\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272326 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-tmp-dir\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272681 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272705 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.273728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.272722 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.275379 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.275359 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:28.275827 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.275809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a26d69c9-3ed0-4d2b-889d-3637029900d5-agent-certs\") pod \"konnectivity-agent-jr9zj\" (UID: \"a26d69c9-3ed0-4d2b-889d-3637029900d5\") " pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.280585 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.280566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vn6\" (UniqueName: \"kubernetes.io/projected/98dde2d6-8c6b-47b6-836a-77fdcc21cec6-kube-api-access-x8vn6\") pod \"node-resolver-fvxk2\" (UID: \"98dde2d6-8c6b-47b6-836a-77fdcc21cec6\") " pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.281067 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.281050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcwq\" (UniqueName: \"kubernetes.io/projected/8cc00222-a6d3-473e-94ed-7145c2f0f053-kube-api-access-8bcwq\") pod \"aws-ebs-csi-driver-node-qrhnw\" (UID: \"8cc00222-a6d3-473e-94ed-7145c2f0f053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.373312 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-system-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.373312 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-k8s-cni-cncf-io\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-node-log\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-node-log\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-system-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-etc-kubernetes\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-k8s-cni-cncf-io\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373482 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.373531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-conf-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-lib-modules\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373577 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-conf-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26f724e0-5994-4d1f-85c5-c8d0506ece4b-iptables-alerter-script\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-etc-kubernetes\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-os-release\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-bin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-multus-certs\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8vk\" (UniqueName: \"kubernetes.io/projected/bd538408-bde8-40e2-8000-cff058c5cc52-kube-api-access-9x8vk\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-bin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-sys\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-lib-modules\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-os-release\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-multus-certs\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26f724e0-5994-4d1f-85c5-c8d0506ece4b-host-slash\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-systemd\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373918 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.374036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-var-lib-kubelet\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-netns\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373977 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-systemd\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26f724e0-5994-4d1f-85c5-c8d0506ece4b-host-slash\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.373911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-sys\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-env-overrides\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-cni-binary-copy\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374074 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-config\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2ws\" (UniqueName: \"kubernetes.io/projected/d7896522-4d08-4a54-a294-858f2db0b75b-kube-api-access-4g2ws\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-var-lib-kubelet\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374252 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26f724e0-5994-4d1f-85c5-c8d0506ece4b-iptables-alerter-script\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374346 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.374947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-netns\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-systemd-units\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-cni-dir\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-kubelet\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-cnibin\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms9rm\" (UniqueName: \"kubernetes.io/projected/b2ff7848-bd32-43d5-a0ab-53c117a23188-kube-api-access-ms9rm\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-socket-dir-parent\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-system-cni-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-cnibin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-slash\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-bin\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ldd\" (UniqueName: \"kubernetes.io/projected/820edf78-8707-43e8-a69c-bdd9f411978f-kube-api-access-x6ldd\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-netns\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374818 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-config\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zczdp\" (UniqueName: \"kubernetes.io/projected/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-kube-api-access-zczdp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-netd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.375990 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374887 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-run\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374917 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374938 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-cnibin\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-os-release\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374952 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-cni-binary-copy\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-multus-daemon-config\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374915 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374989 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-modprobe-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375006 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-host\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-kubernetes\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-run\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-systemd-units\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.374718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-env-overrides\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375150 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-conf\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-conf\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.376816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-os-release\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-kubernetes\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-run-ovn-kubernetes\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375350 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-bin\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-modprobe-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-kubelet\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysconfig\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-multus-socket-dir-parent\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysconfig\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-run-netns\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-slash\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7896522-4d08-4a54-a294-858f2db0b75b-ovn-node-metrics-cert\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-script-lib\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-kubelet\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.375547 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-system-cni-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-host-cni-netd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375663 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.377780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375680 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375687 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375702 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-kubelet\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-cnibin\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375665 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375792 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd538408-bde8-40e2-8000-cff058c5cc52-multus-daemon-config\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375798 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-host\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-sysctl-d\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375841 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.375985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.376025 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-serviceca\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.376087 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret podName:753a3396-d9f1-4ebb-82a1-d3c9d6141cb4 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:28.876066037 +0000 UTC m=+2.954141988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret") pod "global-pull-secret-syncer-tq2vs" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7896522-4d08-4a54-a294-858f2db0b75b-ovnkube-script-lib\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376149 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-multus\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rgd\" (UniqueName: \"kubernetes.io/projected/26f724e0-5994-4d1f-85c5-c8d0506ece4b-kube-api-access-64rgd\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.378835 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-host-var-lib-cni-multus\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-var-lib-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-etc-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376301 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-ovn\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-log-socket\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376352 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-var-lib-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-hostroot\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376418 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-tuned\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-host\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376447 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xgm8\" (UniqueName: \"kubernetes.io/projected/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-kube-api-access-8xgm8\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376471 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376478 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-tmp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376501 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-systemd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.379489 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376517 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-systemd\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-serviceca\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376592 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376615 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376611 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2ff7848-bd32-43d5-a0ab-53c117a23188-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376686 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376706 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd538408-bde8-40e2-8000-cff058c5cc52-hostroot\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376720 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-etc-openvswitch\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376760 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-run-ovn\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7896522-4d08-4a54-a294-858f2db0b75b-log-socket\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376772 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.376867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-host\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.377198 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2ff7848-bd32-43d5-a0ab-53c117a23188-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378022 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378043 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378069 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378075 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378087 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378095 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378120 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378121 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378137 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378149 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378162 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.380160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378049 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378224 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378123 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378271 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.378274 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378287 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.378314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:28.878299662 +0000 UTC m=+2.956375581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378101 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.378414 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.380784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-etc-tuned\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.380970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7896522-4d08-4a54-a294-858f2db0b75b-ovn-node-metrics-cert\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.381264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.381037 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-tmp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.381645 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.381630 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:28.381682 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.381649 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:28.381682 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.381659 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:28.381753 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.381707 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:28.881694935 +0000 UTC m=+2.959770854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:28.384129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.384094 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2ws\" (UniqueName: \"kubernetes.io/projected/d7896522-4d08-4a54-a294-858f2db0b75b-kube-api-access-4g2ws\") pod \"ovnkube-node-96ghh\" (UID: \"d7896522-4d08-4a54-a294-858f2db0b75b\") " pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.384459 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.384438 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8vk\" (UniqueName: \"kubernetes.io/projected/bd538408-bde8-40e2-8000-cff058c5cc52-kube-api-access-9x8vk\") pod \"multus-kvpdg\" (UID: \"bd538408-bde8-40e2-8000-cff058c5cc52\") " pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.389988 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.389968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ldd\" (UniqueName: \"kubernetes.io/projected/820edf78-8707-43e8-a69c-bdd9f411978f-kube-api-access-x6ldd\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.390076 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.390031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zczdp\" (UniqueName: \"kubernetes.io/projected/5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43-kube-api-access-zczdp\") pod \"tuned-nxw9v\" (UID: \"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43\") " pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.390076 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.390032 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms9rm\" (UniqueName: \"kubernetes.io/projected/b2ff7848-bd32-43d5-a0ab-53c117a23188-kube-api-access-ms9rm\") pod \"multus-additional-cni-plugins-p9gbv\" (UID: \"b2ff7848-bd32-43d5-a0ab-53c117a23188\") " pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.391897 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.391876 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:28.392527 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.392509 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 18:19:28.394002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.393985 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xgm8\" (UniqueName: \"kubernetes.io/projected/a4b39dbf-4482-4fc9-9e6e-48bea8305aa2-kube-api-access-8xgm8\") pod \"node-ca-8k9w4\" (UID: \"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2\") " pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.395025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.394999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rgd\" (UniqueName: \"kubernetes.io/projected/26f724e0-5994-4d1f-85c5-c8d0506ece4b-kube-api-access-64rgd\") pod \"iptables-alerter-xm7cm\" (UID: \"26f724e0-5994-4d1f-85c5-c8d0506ece4b\") " pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.398033 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.397990 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c9ddef82fc9ee7511a5d22e04bc018.slice/crio-6a1f274efaeab3437b9d6b8093c03b769db491a163be3ac440ebe85cd3e289a3 WatchSource:0}: Error finding container 6a1f274efaeab3437b9d6b8093c03b769db491a163be3ac440ebe85cd3e289a3: Status 404 returned error can't find the container with id 6a1f274efaeab3437b9d6b8093c03b769db491a163be3ac440ebe85cd3e289a3 Jul 06 18:19:28.403102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.403087 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:19:28.420630 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.420579 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tq2vs" podStartSLOduration=1.420561762 podStartE2EDuration="1.420561762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:28.391790412 +0000 UTC m=+2.469866376" watchObservedRunningTime="2026-07-06 18:19:28.420561762 +0000 UTC m=+2.498637703" Jul 06 18:19:28.462152 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.462107 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 06 18:19:28.475146 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.475116 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 18:19:28.475306 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.475225 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 06 18:19:28.476017 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.475992 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal"] Jul 06 18:19:28.488786 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.488735 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c1950d01285c941f9419cd08660742.slice/crio-c6e086171da4f2c1d3efea78271854d3e3d94e6b52962d9d34a7bfb97fe67a56 WatchSource:0}: Error finding container c6e086171da4f2c1d3efea78271854d3e3d94e6b52962d9d34a7bfb97fe67a56: Status 404 returned error can't find the container with id c6e086171da4f2c1d3efea78271854d3e3d94e6b52962d9d34a7bfb97fe67a56 Jul 06 18:19:28.490773 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.490751 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 18:19:28.492371 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.492342 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal"] Jul 06 18:19:28.492546 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.492530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:28.500039 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.500010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" Jul 06 18:19:28.502135 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.502109 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26d69c9_3ed0_4d2b_889d_3637029900d5.slice/crio-96e8da6d9b49f5366ece9e26758d2bc1712d38a519c71a55f10d2bd3b4ad3651 WatchSource:0}: Error finding container 96e8da6d9b49f5366ece9e26758d2bc1712d38a519c71a55f10d2bd3b4ad3651: Status 404 returned error can't find the container with id 96e8da6d9b49f5366ece9e26758d2bc1712d38a519c71a55f10d2bd3b4ad3651 Jul 06 18:19:28.515365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.515343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvxk2" Jul 06 18:19:28.523929 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.523906 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dde2d6_8c6b_47b6_836a_77fdcc21cec6.slice/crio-3f55240411b2b35c3ade6508d53c90ebb4bae0b3b9f56b7a69e5ff002b1656cb WatchSource:0}: Error finding container 3f55240411b2b35c3ade6508d53c90ebb4bae0b3b9f56b7a69e5ff002b1656cb: Status 404 returned error can't find the container with id 3f55240411b2b35c3ade6508d53c90ebb4bae0b3b9f56b7a69e5ff002b1656cb Jul 06 18:19:28.535336 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.535316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8k9w4" Jul 06 18:19:28.544835 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.544778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b39dbf_4482_4fc9_9e6e_48bea8305aa2.slice/crio-98a8658ef8757dc7437d620525a211ccdb37648792f3dbc7ca931c71efaae8a2 WatchSource:0}: Error finding container 98a8658ef8757dc7437d620525a211ccdb37648792f3dbc7ca931c71efaae8a2: Status 404 returned error can't find the container with id 98a8658ef8757dc7437d620525a211ccdb37648792f3dbc7ca931c71efaae8a2 Jul 06 18:19:28.551176 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.551153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" Jul 06 18:19:28.560915 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.560890 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ff7848_bd32_43d5_a0ab_53c117a23188.slice/crio-71ea6d2d977f6cdf4e6e1024da7a180e1b2e4a50752424712c96be057486d325 WatchSource:0}: Error finding container 71ea6d2d977f6cdf4e6e1024da7a180e1b2e4a50752424712c96be057486d325: Status 404 returned error can't find the container with id 71ea6d2d977f6cdf4e6e1024da7a180e1b2e4a50752424712c96be057486d325 Jul 06 18:19:28.564083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.564065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kvpdg" Jul 06 18:19:28.572661 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.572638 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd538408_bde8_40e2_8000_cff058c5cc52.slice/crio-df42e5af371d769584b2fc4a2b277d1549cdd61c1b5db48a3306ddb826e0cbe3 WatchSource:0}: Error finding container df42e5af371d769584b2fc4a2b277d1549cdd61c1b5db48a3306ddb826e0cbe3: Status 404 returned error can't find the container with id df42e5af371d769584b2fc4a2b277d1549cdd61c1b5db48a3306ddb826e0cbe3 Jul 06 18:19:28.575768 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.575744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" Jul 06 18:19:28.584962 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.584935 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcf1b6c_2a89_4fcd_8dd8_3fe300f05c43.slice/crio-f974eee51fe7fe20361fcf357ad40f103ca3a5f0b331e7ad2482c8d7c022b390 WatchSource:0}: Error finding container f974eee51fe7fe20361fcf357ad40f103ca3a5f0b331e7ad2482c8d7c022b390: Status 404 returned error can't find the container with id f974eee51fe7fe20361fcf357ad40f103ca3a5f0b331e7ad2482c8d7c022b390 Jul 06 18:19:28.592174 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.592149 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xm7cm" Jul 06 18:19:28.596578 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.596550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:28.603661 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.603632 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f724e0_5994_4d1f_85c5_c8d0506ece4b.slice/crio-c0d2e4ab733acbd150fbd229fc4c9b36462effba392b80ab0ba0a9b431d61ba0 WatchSource:0}: Error finding container c0d2e4ab733acbd150fbd229fc4c9b36462effba392b80ab0ba0a9b431d61ba0: Status 404 returned error can't find the container with id c0d2e4ab733acbd150fbd229fc4c9b36462effba392b80ab0ba0a9b431d61ba0 Jul 06 18:19:28.608657 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:19:28.608633 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7896522_4d08_4a54_a294_858f2db0b75b.slice/crio-3b56cf586e222bfde41c42ec847ae8c40494e3d16a0d4d6eaab303bb2d66f68e WatchSource:0}: Error finding container 3b56cf586e222bfde41c42ec847ae8c40494e3d16a0d4d6eaab303bb2d66f68e: Status 404 returned error can't find the container with id 3b56cf586e222bfde41c42ec847ae8c40494e3d16a0d4d6eaab303bb2d66f68e Jul 06 18:19:28.881442 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.881346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:28.881442 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.881419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:28.881635 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.881504 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:28.881635 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.881531 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:28.881635 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.881573 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:29.881555975 +0000 UTC m=+3.959631894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:28.881635 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.881589 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret podName:753a3396-d9f1-4ebb-82a1-d3c9d6141cb4 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:29.881582414 +0000 UTC m=+3.959658336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret") pod "global-pull-secret-syncer-tq2vs" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:28.982615 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:28.982576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:28.982810 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.982733 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:28.982810 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.982756 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:28.982810 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.982770 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:28.982946 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:28.982857 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:29.982816614 +0000 UTC m=+4.060892536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:29.163197 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.163114 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 18:19:29.176100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.175825 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 18:19:29.307016 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.306982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:29.308214 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.307139 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:29.308214 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.307267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:29.308214 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.307349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:29.323517 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.323449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jr9zj" event={"ID":"a26d69c9-3ed0-4d2b-889d-3637029900d5","Type":"ContainerStarted","Data":"96e8da6d9b49f5366ece9e26758d2bc1712d38a519c71a55f10d2bd3b4ad3651"} Jul 06 18:19:29.327617 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.327577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" event={"ID":"d9c1950d01285c941f9419cd08660742","Type":"ContainerStarted","Data":"c6e086171da4f2c1d3efea78271854d3e3d94e6b52962d9d34a7bfb97fe67a56"} Jul 06 18:19:29.329525 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.329491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"3b56cf586e222bfde41c42ec847ae8c40494e3d16a0d4d6eaab303bb2d66f68e"} Jul 06 18:19:29.332234 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.332203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xm7cm" event={"ID":"26f724e0-5994-4d1f-85c5-c8d0506ece4b","Type":"ContainerStarted","Data":"c0d2e4ab733acbd150fbd229fc4c9b36462effba392b80ab0ba0a9b431d61ba0"} Jul 06 18:19:29.336532 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.336496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kvpdg" event={"ID":"bd538408-bde8-40e2-8000-cff058c5cc52","Type":"ContainerStarted","Data":"df42e5af371d769584b2fc4a2b277d1549cdd61c1b5db48a3306ddb826e0cbe3"} Jul 06 18:19:29.344092 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.344057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvxk2" event={"ID":"98dde2d6-8c6b-47b6-836a-77fdcc21cec6","Type":"ContainerStarted","Data":"3f55240411b2b35c3ade6508d53c90ebb4bae0b3b9f56b7a69e5ff002b1656cb"} Jul 06 18:19:29.350989 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.349083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"72c9ddef82fc9ee7511a5d22e04bc018","Type":"ContainerStarted","Data":"6a1f274efaeab3437b9d6b8093c03b769db491a163be3ac440ebe85cd3e289a3"} Jul 06 18:19:29.359442 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.359406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" event={"ID":"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43","Type":"ContainerStarted","Data":"f974eee51fe7fe20361fcf357ad40f103ca3a5f0b331e7ad2482c8d7c022b390"} Jul 06 18:19:29.365376 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.365104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerStarted","Data":"71ea6d2d977f6cdf4e6e1024da7a180e1b2e4a50752424712c96be057486d325"} Jul 06 18:19:29.376646 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.376608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8k9w4" event={"ID":"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2","Type":"ContainerStarted","Data":"98a8658ef8757dc7437d620525a211ccdb37648792f3dbc7ca931c71efaae8a2"} Jul 06 18:19:29.386198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.386162 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config\") pod \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " Jul 06 18:19:29.386385 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.386215 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus\") pod \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " Jul 06 18:19:29.386497 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.386475 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus" (OuterVolumeSpecName: "dbus") pod "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4"). InnerVolumeSpecName "dbus". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 06 18:19:29.386558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.386532 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config" (OuterVolumeSpecName: "kubelet-config") pod "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4"). InnerVolumeSpecName "kubelet-config". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 06 18:19:29.388519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.388486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" event={"ID":"8cc00222-a6d3-473e-94ed-7145c2f0f053","Type":"ContainerStarted","Data":"70681015e21f5163b76a1059da1665678f66131072aea7bad00168796d7e859c"} Jul 06 18:19:29.426505 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.426416 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n47z4" Jul 06 18:19:29.434377 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.434340 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n47z4" Jul 06 18:19:29.486779 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.486744 2574 reconciler_common.go:299] "Volume detached for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-kubelet-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:19:29.486779 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.486780 2574 reconciler_common.go:299] "Volume detached for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-dbus\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:19:29.890630 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.890540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:29.890630 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.890616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:29.890898 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.890755 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:29.890898 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.890821 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret podName:753a3396-d9f1-4ebb-82a1-d3c9d6141cb4 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:31.890801564 +0000 UTC m=+5.968877486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret") pod "global-pull-secret-syncer-tq2vs" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:29.891040 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.890909 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:29.891040 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.890947 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:31.890933679 +0000 UTC m=+5.969009604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:29.991463 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:29.991423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:29.991675 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.991605 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:29.991675 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.991629 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:29.991675 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.991642 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:29.991851 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:29.991704 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:31.991684601 +0000 UTC m=+6.069760520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:30.438150 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:30.438084 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 18:14:29 +0000 UTC" deadline="2027-12-05 14:56:41.206885798 +0000 UTC" Jul 06 18:19:30.438150 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:30.438151 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12404h37m10.76874708s" Jul 06 18:19:31.307218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.306945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:31.307218 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.307107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:31.307815 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.307601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:31.307815 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.307700 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:31.439085 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.438980 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 18:14:29 +0000 UTC" deadline="2027-12-10 01:28:30.012028481 +0000 UTC" Jul 06 18:19:31.439085 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.439022 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12511h8m58.573011527s" Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.904907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:31.904991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.905119 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.905181 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret podName:753a3396-d9f1-4ebb-82a1-d3c9d6141cb4 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:35.905162212 +0000 UTC m=+9.983238137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret") pod "global-pull-secret-syncer-tq2vs" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.905579 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:31.905684 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:31.905629 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:35.905612611 +0000 UTC m=+9.983688531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:32.006071 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:32.005296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:32.006071 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:32.005511 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:32.006071 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:32.005568 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:32.006071 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:32.005583 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:32.006071 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:32.005649 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:36.005631321 +0000 UTC m=+10.083707248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:33.306562 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:33.306530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:33.307061 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:33.306673 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:33.307206 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:33.307184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:33.307351 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:33.307300 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:35.307322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:35.306680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:35.307322 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.306860 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:35.307322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:35.306944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:35.307322 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.307062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:35.932633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:35.932708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") pod \"global-pull-secret-syncer-tq2vs\" (UID: \"753a3396-d9f1-4ebb-82a1-d3c9d6141cb4\") " pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.932849 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.932911 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret podName:753a3396-d9f1-4ebb-82a1-d3c9d6141cb4 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:43.932893022 +0000 UTC m=+18.010968961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret") pod "global-pull-secret-syncer-tq2vs" (UID: "753a3396-d9f1-4ebb-82a1-d3c9d6141cb4") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.933291 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:35.933368 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:35.933333 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:43.933319471 +0000 UTC m=+18.011395389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:36.033359 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:36.033315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:36.033546 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:36.033508 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:36.033546 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:36.033537 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:36.033643 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:36.033555 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:36.033643 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:36.033631 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:44.03360659 +0000 UTC m=+18.111682527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:37.307261 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.307226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:37.307738 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.307367 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:37.307738 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.307411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:37.307738 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.307498 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:37.353231 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.353194 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-tq2vs"] Jul 06 18:19:37.353465 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.353314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:37.356750 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.356720 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-tq2vs"] Jul 06 18:19:37.358192 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.358151 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-tq2vs\" is forbidden: User \"system:node:ip-10-0-132-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-132-134.ec2.internal' and this object" podUID="753a3396-d9f1-4ebb-82a1-d3c9d6141cb4" pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:37.378015 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.377441 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s8mnz"] Jul 06 18:19:37.380893 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.380862 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.381075 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.380946 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:37.395448 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.395405 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-tq2vs\" is forbidden: User \"system:node:ip-10-0-132-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-132-134.ec2.internal' and this object" podUID="753a3396-d9f1-4ebb-82a1-d3c9d6141cb4" pod="kube-system/global-pull-secret-syncer-tq2vs" Jul 06 18:19:37.443658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.443441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-kubelet-config\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.443658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.443486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.443658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.443563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-dbus\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.443658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.443597 2574 reconciler_common.go:299] "Volume detached for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/753a3396-d9f1-4ebb-82a1-d3c9d6141cb4-original-pull-secret\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:19:37.544945 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.544911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-kubelet-config\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.545112 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.544958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.545112 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.545034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-dbus\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.545221 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.545206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-dbus\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.545278 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:37.545267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1ead76-3dde-431e-b231-34ffcc6e7578-kubelet-config\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:37.545379 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.545363 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:37.545444 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:37.545433 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:38.04541244 +0000 UTC m=+12.123488358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:38.049077 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:38.049040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:38.049272 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:38.049165 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:38.049272 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:38.049250 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:39.04922851 +0000 UTC m=+13.127304439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:39.058484 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:39.058448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:39.058970 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:39.058611 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:39.058970 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:39.058688 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:41.058668854 +0000 UTC m=+15.136744781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:39.306218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:39.306180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:39.306384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:39.306187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:39.306384 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:39.306317 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:39.306488 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:39.306187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:39.306488 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:39.306407 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:39.306585 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:39.306493 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:41.074126 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:41.074080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:41.074577 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:41.074238 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:41.074577 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:41.074324 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:45.074303239 +0000 UTC m=+19.152379171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:41.306579 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:41.306542 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:41.306770 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:41.306610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:41.306770 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:41.306710 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:41.306968 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:41.306941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:41.307100 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:41.307074 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:41.307163 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:41.307114 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:43.306458 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:43.306423 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:43.306971 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:43.306440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:43.306971 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:43.306556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:43.306971 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:43.306553 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:43.306971 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:43.306673 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:43.306971 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:43.306772 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:43.994015 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:43.993968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:43.994216 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:43.994086 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:43.994216 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:43.994146 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:19:59.994128793 +0000 UTC m=+34.072204723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:19:44.095148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:44.095108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:44.095344 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:44.095303 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:19:44.095344 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:44.095330 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:19:44.095344 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:44.095345 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:44.095490 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:44.095417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:00.095395768 +0000 UTC m=+34.173471705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:19:45.101849 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:45.101780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:45.102369 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:45.101945 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:45.102369 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:45.102022 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:19:53.102000513 +0000 UTC m=+27.180076450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:45.310537 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:45.310506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:45.310537 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:45.310517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:45.310537 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:45.310519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:45.310826 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:45.310625 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:45.310826 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:45.310706 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:45.310826 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:45.310753 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:47.307494 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:47.307460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:47.307944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:47.307566 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:47.307944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:47.307589 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:47.307944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:47.307604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:47.307944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:47.307681 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:47.307944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:47.307748 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:49.306850 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.306597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:49.307390 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.306621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:49.307390 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:49.306945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:49.307390 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.306700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:49.307390 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:49.307084 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:49.307390 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:49.307021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:49.445625 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.445415 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" event={"ID":"5fcf1b6c-2a89-4fcd-8dd8-3fe300f05c43","Type":"ContainerStarted","Data":"7c4f9de6fa50cd666869df6a886ffcb9e77b6bb2d60d3789e57ce9efc1936523"} Jul 06 18:19:49.447079 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.447052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" event={"ID":"d9c1950d01285c941f9419cd08660742","Type":"ContainerStarted","Data":"c9053c73c5438e6879b87778c83b15442e26e23a707360b18be1548c10e4b732"} Jul 06 18:19:49.449621 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.449599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"7cced44b2e2a7b1ede963168f1b9d15986cfa49d3f3139357cc697c9240754f6"} Jul 06 18:19:49.449718 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.449669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"73e75bc202451bd45634d9d74d7a8e5a89613f4acfa0ca2629a84543a696fb3f"} Jul 06 18:19:49.449718 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.449708 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"4690375810c91667224a033772859b4ac2b63764315a033b2adc36197c539e3c"} Jul 06 18:19:49.449842 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.449756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"99952f9156888c2798737e26fa85a1c101a300951eea546b3e5f564597eb5ffa"} Jul 06 18:19:49.451168 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.451146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kvpdg" event={"ID":"bd538408-bde8-40e2-8000-cff058c5cc52","Type":"ContainerStarted","Data":"0d47b61febab3b4739e306737ea62aee3bacfae956e69cdf25bf9a50b375333f"} Jul 06 18:19:49.469947 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.467661 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nxw9v" podStartSLOduration=2.273055195 podStartE2EDuration="22.467637066s" totalImagesPullingTime="20.194581871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:49.466894833 +0000 UTC m=+23.544970794" watchObservedRunningTime="2026-07-06 18:19:49.467637066 +0000 UTC m=+23.545713003" Jul 06 18:19:49.497991 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.497939 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kvpdg" podStartSLOduration=2.073109759 podStartE2EDuration="22.497924732s" totalImagesPullingTime="20.424814973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:49.497857179 +0000 UTC m=+23.575933135" watchObservedRunningTime="2026-07-06 18:19:49.497924732 +0000 UTC m=+23.576000667" Jul 06 18:19:49.551224 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:49.551025 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" podStartSLOduration=21.551007623 podStartE2EDuration="21.551007623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:49.550945953 +0000 UTC m=+23.629021902" watchObservedRunningTime="2026-07-06 18:19:49.551007623 +0000 UTC m=+23.629083556" Jul 06 18:19:50.454970 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.454885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" event={"ID":"8cc00222-a6d3-473e-94ed-7145c2f0f053","Type":"ContainerStarted","Data":"5c936113118ca39fd862b262313649ef5a614fe3f0930bba100e98c1b7f65b48"} Jul 06 18:19:50.456225 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.456201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jr9zj" event={"ID":"a26d69c9-3ed0-4d2b-889d-3637029900d5","Type":"ContainerStarted","Data":"1be2a33b3c18c70529a9ebe572d2a8df36e332f89c0c243fb5ec91ffbd30e8f2"} Jul 06 18:19:50.458891 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.458852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"be06edaece4bab915e95a34bada1e387c5e37c4cbc3ba9abf36556d5a6ca0947"} Jul 06 18:19:50.458989 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.458929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"fb1317d4ca0439eb6a8156fbc5d7e9bafbb7c1be657af869ba91a39fe6b91c3f"} Jul 06 18:19:50.460192 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.460173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xm7cm" event={"ID":"26f724e0-5994-4d1f-85c5-c8d0506ece4b","Type":"ContainerStarted","Data":"6db70df5e445fed65482bb6788ae64e5ed2a8840688685c66201dcfb46e4da4c"} Jul 06 18:19:50.461568 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.461550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvxk2" event={"ID":"98dde2d6-8c6b-47b6-836a-77fdcc21cec6","Type":"ContainerStarted","Data":"61aa707bf90293d1ea2ffd0e08e4c2d72b2a55aab3a9241193a828782eb225fa"} Jul 06 18:19:50.462852 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.462833 2574 generic.go:356] "Generic (PLEG): container finished" podID="72c9ddef82fc9ee7511a5d22e04bc018" containerID="1a312e4283793bb938cd2c0504774e842e7b7d79a009556e0ef1990158d48c16" exitCode=0 Jul 06 18:19:50.462924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.462897 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"72c9ddef82fc9ee7511a5d22e04bc018","Type":"ContainerDied","Data":"1a312e4283793bb938cd2c0504774e842e7b7d79a009556e0ef1990158d48c16"} Jul 06 18:19:50.464363 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.464340 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="78b7e16c0d0b7a27699a44820843d5a61b2e28e9fc4a716b33f6c23d959642f4" exitCode=0 Jul 06 18:19:50.464455 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.464397 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"78b7e16c0d0b7a27699a44820843d5a61b2e28e9fc4a716b33f6c23d959642f4"} Jul 06 18:19:50.467955 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.467932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8k9w4" event={"ID":"a4b39dbf-4482-4fc9-9e6e-48bea8305aa2","Type":"ContainerStarted","Data":"bc86ba71a048b84dc3b233ba7ebe53b209fb2a3fd2ddfd51d67525ac820739ff"} Jul 06 18:19:50.472042 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.472001 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jr9zj" podStartSLOduration=7.767523877 podStartE2EDuration="23.47198699s" totalImagesPullingTime="15.704463113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:50.471771611 +0000 UTC m=+24.549847546" watchObservedRunningTime="2026-07-06 18:19:50.47198699 +0000 UTC m=+24.550062926" Jul 06 18:19:50.522728 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.522665 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xm7cm" podStartSLOduration=7.91943015 podStartE2EDuration="23.52264609s" totalImagesPullingTime="15.60321594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:50.522484261 +0000 UTC m=+24.600560220" watchObservedRunningTime="2026-07-06 18:19:50.52264609 +0000 UTC m=+24.600722027" Jul 06 18:19:50.537712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.537664 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fvxk2" podStartSLOduration=3.282124454 podStartE2EDuration="23.537644881s" totalImagesPullingTime="20.255520427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:50.537102276 +0000 UTC m=+24.615178212" watchObservedRunningTime="2026-07-06 18:19:50.537644881 +0000 UTC m=+24.615720818" Jul 06 18:19:50.551365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:50.551318 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8k9w4" podStartSLOduration=3.316679691 podStartE2EDuration="23.55130232s" totalImagesPullingTime="20.234622629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:50.55127135 +0000 UTC m=+24.629347307" watchObservedRunningTime="2026-07-06 18:19:50.55130232 +0000 UTC m=+24.629378252" Jul 06 18:19:51.288513 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.288481 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 18:19:51.306485 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.306460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:51.306628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.306461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:51.306628 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:51.306579 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:51.306711 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.306461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:51.306711 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:51.306669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:51.306711 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:51.306703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:51.471918 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.471819 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"72c9ddef82fc9ee7511a5d22e04bc018","Type":"ContainerStarted","Data":"c5040feaa99d6d97b2ff4fdba728e8e9828b5f89125502cdf67b54b3a4f0c673"} Jul 06 18:19:51.473976 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.473948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" event={"ID":"8cc00222-a6d3-473e-94ed-7145c2f0f053","Type":"ContainerStarted","Data":"1dc28150ea5582d5da23874c7bf848b93efd2a281d5685b147f96dfd2432fd55"} Jul 06 18:19:51.495161 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.495097 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" podStartSLOduration=23.495075728 podStartE2EDuration="23.495075728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:51.494171342 +0000 UTC m=+25.572247279" watchObservedRunningTime="2026-07-06 18:19:51.495075728 +0000 UTC m=+25.573151664" Jul 06 18:19:51.786135 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.786103 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:51.786726 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:51.786704 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:52.238934 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.238839 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T18:19:51.288508076Z","UUID":"41a2eb77-d08f-4d82-bc80-5735871c6819","Handler":null,"Name":"","Endpoint":""} Jul 06 18:19:52.240379 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.240359 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 18:19:52.240483 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.240397 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 18:19:52.480493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.480450 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"2bd1b840705dcea7a3b7602fa286b9b72a0689e124eb43fc150c098c75be1919"} Jul 06 18:19:52.480984 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.480893 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:52.481280 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:52.481259 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jr9zj" Jul 06 18:19:53.156636 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.156602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:53.156800 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:53.156726 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:53.156800 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:53.156776 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret podName:cf1ead76-3dde-431e-b231-34ffcc6e7578 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.156762819 +0000 UTC m=+43.234838733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret") pod "global-pull-secret-syncer-s8mnz" (UID: "cf1ead76-3dde-431e-b231-34ffcc6e7578") : object "kube-system"/"original-pull-secret" not registered Jul 06 18:19:53.306979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.306942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:53.307145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.306942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:53.307145 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:53.307055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:53.307145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.307074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:53.307145 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:53.307120 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:53.307372 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:53.307181 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:53.484473 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.484387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" event={"ID":"8cc00222-a6d3-473e-94ed-7145c2f0f053","Type":"ContainerStarted","Data":"294d907d02a2d2bb826a9e5809872b3a43a636746496dc49ac7a2146041c211f"} Jul 06 18:19:53.503250 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:53.503199 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrhnw" podStartSLOduration=7.775894109 podStartE2EDuration="26.503184262s" totalImagesPullingTime="18.727290153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:53.501876981 +0000 UTC m=+27.579952943" watchObservedRunningTime="2026-07-06 18:19:53.503184262 +0000 UTC m=+27.581260198" Jul 06 18:19:54.489363 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:54.489109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" event={"ID":"d7896522-4d08-4a54-a294-858f2db0b75b","Type":"ContainerStarted","Data":"ab549d32d9cf705f65210a26d74f4fe48daecb1cfa6c885dbb6e1f6433d48778"} Jul 06 18:19:54.517892 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:54.517825 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" podStartSLOduration=7.271437694 podStartE2EDuration="27.517806349s" totalImagesPullingTime="20.246368655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:54.517142039 +0000 UTC m=+28.595217980" watchObservedRunningTime="2026-07-06 18:19:54.517806349 +0000 UTC m=+28.595882287" Jul 06 18:19:55.306905 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.306869 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:55.307088 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.306878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:55.307088 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.307025 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:55.307088 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.307050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:55.307259 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.307188 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:55.307310 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.307284 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:55.491551 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.491521 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:55.491979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.491607 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:55.491979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.491657 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:55.507639 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.507614 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:55.507816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.507731 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:19:55.921945 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.921713 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8mnz"] Jul 06 18:19:55.922178 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.922031 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:55.922178 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.922123 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:55.924929 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.924885 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cs5mt"] Jul 06 18:19:55.925149 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.924977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:55.925149 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.925073 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:55.925523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.925499 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk6bh"] Jul 06 18:19:55.925611 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:55.925591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:55.925707 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:55.925687 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:57.307654 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:57.307620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:57.308148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:57.307758 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:57.308148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:57.307811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:57.308148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:57.307882 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:19:58.306184 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:58.306152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:19:58.306329 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:58.306264 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:19:58.500362 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:58.500325 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="337bc8675cd8c8f8ae98be285faeb03554c0caab5fd7040b7ca51bbb80ea50da" exitCode=0 Jul 06 18:19:58.500816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:58.500394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"337bc8675cd8c8f8ae98be285faeb03554c0caab5fd7040b7ca51bbb80ea50da"} Jul 06 18:19:59.306953 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:59.306920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:19:59.307119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:19:59.306927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:19:59.307119 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:59.307063 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:19:59.307215 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:19:59.307118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:20:00.002100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:00.002075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:00.002451 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.002194 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:20:00.002451 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.002243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs podName:820edf78-8707-43e8-a69c-bdd9f411978f nodeName:}" failed. No retries permitted until 2026-07-06 18:20:32.002231149 +0000 UTC m=+66.080307063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs") pod "network-metrics-daemon-lk6bh" (UID: "820edf78-8707-43e8-a69c-bdd9f411978f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 18:20:00.103522 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:00.103416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:00.103674 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.103568 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 18:20:00.103674 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.103594 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 18:20:00.103674 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.103608 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5wjmk for pod openshift-network-diagnostics/network-check-target-cs5mt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:20:00.103674 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.103666 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk podName:649474d8-eaed-4431-b89e-ff57e0d4dfe8 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:32.103647442 +0000 UTC m=+66.181723368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wjmk" (UniqueName: "kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk") pod "network-check-target-cs5mt" (UID: "649474d8-eaed-4431-b89e-ff57e0d4dfe8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 18:20:00.306341 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:00.306157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:00.306497 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:00.306427 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs5mt" podUID="649474d8-eaed-4431-b89e-ff57e0d4dfe8" Jul 06 18:20:00.507195 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:00.507161 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="7b8133a0799878b368aeada9605648aa48e4d0bd4cc0aae8307e01abbe899987" exitCode=0 Jul 06 18:20:00.507349 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:00.507209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"7b8133a0799878b368aeada9605648aa48e4d0bd4cc0aae8307e01abbe899987"} Jul 06 18:20:01.306439 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.306403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:01.306849 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.306403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:20:01.306849 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:01.306535 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk6bh" podUID="820edf78-8707-43e8-a69c-bdd9f411978f" Jul 06 18:20:01.306849 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:01.306595 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8mnz" podUID="cf1ead76-3dde-431e-b231-34ffcc6e7578" Jul 06 18:20:01.829480 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.829404 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeReady" Jul 06 18:20:01.829666 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.829533 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 18:20:01.864512 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.864479 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:20:01.872608 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.872583 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5"] Jul 06 18:20:01.872752 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.872700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.875425 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.875402 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 18:20:01.875563 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.875473 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 18:20:01.875563 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.875483 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 18:20:01.875826 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.875808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h42sk\"" Jul 06 18:20:01.880524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.880503 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" Jul 06 18:20:01.881152 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.881133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-cjms7"] Jul 06 18:20:01.883597 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.883418 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 18:20:01.885030 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.885011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-csjb4\"" Jul 06 18:20:01.885131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.885060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.885388 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.885227 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.890910 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.890888 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565"] Jul 06 18:20:01.891010 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.890997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.894223 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.894203 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.894316 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.894262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 18:20:01.894316 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.894275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 18:20:01.894523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.894508 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fbfk7\"" Jul 06 18:20:01.894748 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.894735 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.899147 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.899129 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 18:20:01.905333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.905308 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f6df67dcf-4vpzr"] Jul 06 18:20:01.905457 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.905409 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:01.908965 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.908939 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gvd6x\"" Jul 06 18:20:01.909109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.909085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.909229 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.909206 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.909937 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.909915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 18:20:01.911927 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.911902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 18:20:01.916946 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.916926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsxd7\" (UniqueName: \"kubernetes.io/projected/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-kube-api-access-rsxd7\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917061 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.916964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917061 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.916995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917061 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917168 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917168 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917294 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917294 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-tmp\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917294 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-serving-cert\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917441 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917441 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-snapshots\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:01.917441 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p2dm\" (UniqueName: \"kubernetes.io/projected/4368953e-2c4f-4f8f-acbe-dfa035dbbb8d-kube-api-access-2p2dm\") pod \"volume-data-source-validator-5d456fdbcd-fzkb5\" (UID: \"4368953e-2c4f-4f8f-acbe-dfa035dbbb8d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" Jul 06 18:20:01.917573 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917573 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.917573 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.917496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4j6\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:01.919522 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.919502 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg"] Jul 06 18:20:01.919641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.919626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:01.925804 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.925765 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 18:20:01.927838 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.927818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.929009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.928984 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 18:20:01.929114 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.929056 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.929114 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.929071 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnzkz\"" Jul 06 18:20:01.929221 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.929113 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 18:20:01.929712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.929697 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 18:20:01.936027 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-cjms7"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936093 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f6df67dcf-4vpzr"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936107 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dwp97"] Jul 06 18:20:01.936155 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.936140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:01.940651 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.940625 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9s8rc\"" Jul 06 18:20:01.941699 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.941596 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.941828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.941809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.943421 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.943407 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 18:20:01.943519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.943451 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 18:20:01.948166 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.948146 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n"] Jul 06 18:20:01.948282 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.948254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:01.951284 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.951266 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 18:20:01.951863 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.951833 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 18:20:01.951960 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.951876 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9wdv2\"" Jul 06 18:20:01.962691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.962667 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6"] Jul 06 18:20:01.962839 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.962769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:01.965378 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.965358 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 18:20:01.965590 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.965566 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.975015 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.974995 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cgj92"] Jul 06 18:20:01.975139 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.975118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:01.983356 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.983334 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.983482 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.983416 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-28vl6\"" Jul 06 18:20:01.985216 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.985197 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-54qvj"] Jul 06 18:20:01.985319 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.985309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:01.988275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988244 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:20:01.988393 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988280 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 18:20:01.988393 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988331 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zmc9l\"" Jul 06 18:20:01.988507 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988414 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 18:20:01.988507 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 18:20:01.988609 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988595 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8zhh\"" Jul 06 18:20:01.988706 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 18:20:01.988828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:01.988686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 18:20:02.001515 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.001486 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk"] Jul 06 18:20:02.001656 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.001589 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.006612 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.006586 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7lg9f\"" Jul 06 18:20:02.006751 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.006696 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:20:02.006751 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.006699 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 18:20:02.007032 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.007006 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 18:20:02.007032 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.007007 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 18:20:02.015137 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.015103 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 18:20:02.015987 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.015964 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-95jw2"] Jul 06 18:20:02.016113 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.016090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" Jul 06 18:20:02.017761 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56vx\" (UniqueName: \"kubernetes.io/projected/3d9bd0df-c5ad-4e06-af60-5810eacd4801-kube-api-access-t56vx\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.017887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.017887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-tmp\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.017887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.018013 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352c0f19-8001-4609-a035-dfa6a9870099-config-volume\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.018013 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.017952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhsj\" (UniqueName: \"kubernetes.io/projected/352c0f19-8001-4609-a035-dfa6a9870099-kube-api-access-vnhsj\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.018095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9bc\" (UniqueName: \"kubernetes.io/projected/d5b86957-9567-47c7-89b5-d8bbe146942e-kube-api-access-dw9bc\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.018095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-snapshots\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.018095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p2dm\" (UniqueName: \"kubernetes.io/projected/4368953e-2c4f-4f8f-acbe-dfa035dbbb8d-kube-api-access-2p2dm\") pod \"volume-data-source-validator-5d456fdbcd-fzkb5\" (UID: \"4368953e-2c4f-4f8f-acbe-dfa035dbbb8d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" Jul 06 18:20:02.018095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d5b86957-9567-47c7-89b5-d8bbe146942e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.018277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg5nc\" (UniqueName: \"kubernetes.io/projected/d9931666-f427-4ab5-8cfc-256777022f89-kube-api-access-zg5nc\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.018277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.018277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-tmp\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.018277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c0f19-8001-4609-a035-dfa6a9870099-tmp-dir\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsxd7\" (UniqueName: \"kubernetes.io/projected/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-kube-api-access-rsxd7\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42c61b44-fb83-4c62-be09-5aa4f451601f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42c61b44-fb83-4c62-be09-5aa4f451601f-config\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-snapshots\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.018652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-serving-cert\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt95x\" (UniqueName: \"kubernetes.io/projected/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-kube-api-access-bt95x\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018772 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pmptn\"" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkmjv\" (UniqueName: \"kubernetes.io/projected/42c61b44-fb83-4c62-be09-5aa4f451601f-kube-api-access-mkmjv\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.018995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-default-certificate\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4j6\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019075 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019129 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019132 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.019147 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.019161 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-stats-auth\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.019221 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.519204509 +0000 UTC m=+36.597280437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11cf91b7-382e-4b5e-ba7a-2c77bb189225-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.019944 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.020431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.019983 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.020431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.020160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.023074 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.023045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-serving-cert\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.023180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.023088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.023495 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.023472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.031888 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.031865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p2dm\" (UniqueName: \"kubernetes.io/projected/4368953e-2c4f-4f8f-acbe-dfa035dbbb8d-kube-api-access-2p2dm\") pod \"volume-data-source-validator-5d456fdbcd-fzkb5\" (UID: \"4368953e-2c4f-4f8f-acbe-dfa035dbbb8d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" Jul 06 18:20:02.032207 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.032175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsxd7\" (UniqueName: \"kubernetes.io/projected/e504b025-c2f2-4e9f-83d6-cc17e9f67a3e-kube-api-access-rsxd7\") pod \"insights-operator-5c847dcfc4-cjms7\" (UID: \"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e\") " pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.032330 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.032232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4j6\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.032569 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.032547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.040966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.040944 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565"] Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.040984 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dwp97"] Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n"] Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95jw2"] Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041056 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk"] Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041060 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.041090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041081 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6"] Jul 06 18:20:02.041333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-54qvj"] Jul 06 18:20:02.041333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.041117 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cgj92"] Jul 06 18:20:02.043967 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.043949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dkzn2\"" Jul 06 18:20:02.044222 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.044200 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 18:20:02.044222 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.044219 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 18:20:02.044382 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.044253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 18:20:02.120016 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.119939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c0f19-8001-4609-a035-dfa6a9870099-tmp-dir\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.120016 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.119980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.120016 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.119997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42c61b44-fb83-4c62-be09-5aa4f451601f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.120269 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120094 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:02.120269 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120164 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.620147458 +0000 UTC m=+36.698223372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:02.120269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.120269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42c61b44-fb83-4c62-be09-5aa4f451601f-config\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.120446 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120287 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:02.120446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhj9r\" (UniqueName: \"kubernetes.io/projected/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-kube-api-access-qhj9r\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.120446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt95x\" (UniqueName: \"kubernetes.io/projected/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-kube-api-access-bt95x\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.120446 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120359 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.62034214 +0000 UTC m=+36.698418095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:02.120446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c0f19-8001-4609-a035-dfa6a9870099-tmp-dir\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-cert\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e45e6e1-bb7b-407f-a75a-697c16d3f155-serving-cert\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120587 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkmjv\" (UniqueName: \"kubernetes.io/projected/42c61b44-fb83-4c62-be09-5aa4f451601f-kube-api-access-mkmjv\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-trusted-ca\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120588 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120638 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.620624551 +0000 UTC m=+36.698700471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:02.120673 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120674 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.620663457 +0000 UTC m=+36.698739373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-default-certificate\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42c61b44-fb83-4c62-be09-5aa4f451601f-config\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.120871 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.620858649 +0000 UTC m=+36.698934566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-stats-auth\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11cf91b7-382e-4b5e-ba7a-2c77bb189225-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56vx\" (UniqueName: \"kubernetes.io/projected/3d9bd0df-c5ad-4e06-af60-5810eacd4801-kube-api-access-t56vx\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.120996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257sj\" (UniqueName: \"kubernetes.io/projected/bfa4577c-9130-43c7-97f7-15c4a5ce3649-kube-api-access-257sj\") pod \"network-check-source-989f8b8dc-rstrk\" (UID: \"bfa4577c-9130-43c7-97f7-15c4a5ce3649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsh66\" (UniqueName: \"kubernetes.io/projected/5e45e6e1-bb7b-407f-a75a-697c16d3f155-kube-api-access-xsh66\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352c0f19-8001-4609-a035-dfa6a9870099-config-volume\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhsj\" (UniqueName: \"kubernetes.io/projected/352c0f19-8001-4609-a035-dfa6a9870099-kube-api-access-vnhsj\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9bc\" (UniqueName: \"kubernetes.io/projected/d5b86957-9567-47c7-89b5-d8bbe146942e-kube-api-access-dw9bc\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.121238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-config\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d5b86957-9567-47c7-89b5-d8bbe146942e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121715 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352c0f19-8001-4609-a035-dfa6a9870099-config-volume\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg5nc\" (UniqueName: \"kubernetes.io/projected/d9931666-f427-4ab5-8cfc-256777022f89-kube-api-access-zg5nc\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.121803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.121927 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:02.122004 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.121974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:02.621959301 +0000 UTC m=+36.700035229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:02.122300 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.122058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.122300 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.122278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11cf91b7-382e-4b5e-ba7a-2c77bb189225-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.122420 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.122402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d5b86957-9567-47c7-89b5-d8bbe146942e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.122643 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.122626 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42c61b44-fb83-4c62-be09-5aa4f451601f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.123315 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.123295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-default-certificate\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.123408 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.123299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.123449 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.123428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-stats-auth\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.132160 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.132096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt95x\" (UniqueName: \"kubernetes.io/projected/529ec593-61d5-4c6c-9ba4-b87d3d0e7e56-kube-api-access-bt95x\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8565\" (UID: \"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.132607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.132580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9bc\" (UniqueName: \"kubernetes.io/projected/d5b86957-9567-47c7-89b5-d8bbe146942e-kube-api-access-dw9bc\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.133029 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.133010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg5nc\" (UniqueName: \"kubernetes.io/projected/d9931666-f427-4ab5-8cfc-256777022f89-kube-api-access-zg5nc\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.134231 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.134214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkmjv\" (UniqueName: \"kubernetes.io/projected/42c61b44-fb83-4c62-be09-5aa4f451601f-kube-api-access-mkmjv\") pod \"service-ca-operator-5d46d9ffd4-mtzs6\" (UID: \"42c61b44-fb83-4c62-be09-5aa4f451601f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.134425 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.134406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56vx\" (UniqueName: \"kubernetes.io/projected/3d9bd0df-c5ad-4e06-af60-5810eacd4801-kube-api-access-t56vx\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.134467 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.134407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhsj\" (UniqueName: \"kubernetes.io/projected/352c0f19-8001-4609-a035-dfa6a9870099-kube-api-access-vnhsj\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.140731 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.140704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:02.191121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.191085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" Jul 06 18:20:02.199636 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.199612 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" Jul 06 18:20:02.219130 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.219110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" Jul 06 18:20:02.222554 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257sj\" (UniqueName: \"kubernetes.io/projected/bfa4577c-9130-43c7-97f7-15c4a5ce3649-kube-api-access-257sj\") pod \"network-check-source-989f8b8dc-rstrk\" (UID: \"bfa4577c-9130-43c7-97f7-15c4a5ce3649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" Jul 06 18:20:02.222554 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsh66\" (UniqueName: \"kubernetes.io/projected/5e45e6e1-bb7b-407f-a75a-697c16d3f155-kube-api-access-xsh66\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.222554 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-config\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.222698 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhj9r\" (UniqueName: \"kubernetes.io/projected/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-kube-api-access-qhj9r\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.222698 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-cert\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.222698 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e45e6e1-bb7b-407f-a75a-697c16d3f155-serving-cert\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.222874 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.222702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-trusted-ca\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.223344 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.223315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-config\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.223537 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.223520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e45e6e1-bb7b-407f-a75a-697c16d3f155-trusted-ca\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.225028 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.225004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e45e6e1-bb7b-407f-a75a-697c16d3f155-serving-cert\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.225102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.225031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-cert\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.231472 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.231442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-257sj\" (UniqueName: \"kubernetes.io/projected/bfa4577c-9130-43c7-97f7-15c4a5ce3649-kube-api-access-257sj\") pod \"network-check-source-989f8b8dc-rstrk\" (UID: \"bfa4577c-9130-43c7-97f7-15c4a5ce3649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" Jul 06 18:20:02.231585 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.231493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsh66\" (UniqueName: \"kubernetes.io/projected/5e45e6e1-bb7b-407f-a75a-697c16d3f155-kube-api-access-xsh66\") pod \"console-operator-68b757fb67-54qvj\" (UID: \"5e45e6e1-bb7b-407f-a75a-697c16d3f155\") " pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.231828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.231810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhj9r\" (UniqueName: \"kubernetes.io/projected/6c5f36f3-6e1e-4c18-8031-8fde16839bf7-kube-api-access-qhj9r\") pod \"ingress-canary-95jw2\" (UID: \"6c5f36f3-6e1e-4c18-8031-8fde16839bf7\") " pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.249081 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.248864 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:02.284184 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.283884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" Jul 06 18:20:02.313971 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.313274 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:02.313971 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.313636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:02.321411 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.317032 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpmrs\"" Jul 06 18:20:02.331859 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.331612 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" Jul 06 18:20:02.350134 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.350102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95jw2" Jul 06 18:20:02.415470 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.415262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-cjms7"] Jul 06 18:20:02.443644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.443010 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5"] Jul 06 18:20:02.446070 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.446026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565"] Jul 06 18:20:02.511700 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.511670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6"] Jul 06 18:20:02.513558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.513532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" event={"ID":"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56","Type":"ContainerStarted","Data":"c65218b1ce4ab253a044bc0239d8eb34f3223c4022e62367b21b9b1daa1006ee"} Jul 06 18:20:02.514959 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.514928 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" event={"ID":"4368953e-2c4f-4f8f-acbe-dfa035dbbb8d","Type":"ContainerStarted","Data":"7f974bedc3dc319d258788876578e30453077ebdca08aa3fa857f4adced4464f"} Jul 06 18:20:02.515457 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:02.515419 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c61b44_fb83_4c62_be09_5aa4f451601f.slice/crio-c1b9671fe8db566fdc2bb3c8e0c00c267ade6d5d240f8b98604e5a80687ff623 WatchSource:0}: Error finding container c1b9671fe8db566fdc2bb3c8e0c00c267ade6d5d240f8b98604e5a80687ff623: Status 404 returned error can't find the container with id c1b9671fe8db566fdc2bb3c8e0c00c267ade6d5d240f8b98604e5a80687ff623 Jul 06 18:20:02.516325 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.516289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" event={"ID":"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e","Type":"ContainerStarted","Data":"1ee8a2c8f5ddb19cf776bcd50fba0432a8dcc14bff19789bbf70fe8420aa8171"} Jul 06 18:20:02.519204 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.519168 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="4c5f2b7b6cd52319444d8ffada393fedaff56f633fdf24bac50ed16921a2a060" exitCode=0 Jul 06 18:20:02.519304 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.519215 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"4c5f2b7b6cd52319444d8ffada393fedaff56f633fdf24bac50ed16921a2a060"} Jul 06 18:20:02.524771 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.524750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-54qvj"] Jul 06 18:20:02.526519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.526495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:02.526643 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.526620 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:02.526705 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.526647 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:02.526749 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.526710 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.526690998 +0000 UTC m=+37.604766934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:02.527108 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:02.527087 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e45e6e1_bb7b_407f_a75a_697c16d3f155.slice/crio-45a527bf5c1bdae4294129545c1158f1964c26038623fc7f0a4cb6a3587dcc21 WatchSource:0}: Error finding container 45a527bf5c1bdae4294129545c1158f1964c26038623fc7f0a4cb6a3587dcc21: Status 404 returned error can't find the container with id 45a527bf5c1bdae4294129545c1158f1964c26038623fc7f0a4cb6a3587dcc21 Jul 06 18:20:02.542641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.542612 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk"] Jul 06 18:20:02.545853 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:02.545828 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa4577c_9130_43c7_97f7_15c4a5ce3649.slice/crio-13e0b03b185d1dabeb08f30419a744d5339bc6877a3137c931057eae7c9eca8d WatchSource:0}: Error finding container 13e0b03b185d1dabeb08f30419a744d5339bc6877a3137c931057eae7c9eca8d: Status 404 returned error can't find the container with id 13e0b03b185d1dabeb08f30419a744d5339bc6877a3137c931057eae7c9eca8d Jul 06 18:20:02.550822 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.550779 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95jw2"] Jul 06 18:20:02.553557 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:02.553533 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5f36f3_6e1e_4c18_8031_8fde16839bf7.slice/crio-ef730673443f9f9c1bbdf969a4587367d695839f79aacf724fe00c2904991a07 WatchSource:0}: Error finding container ef730673443f9f9c1bbdf969a4587367d695839f79aacf724fe00c2904991a07: Status 404 returned error can't find the container with id ef730673443f9f9c1bbdf969a4587367d695839f79aacf724fe00c2904991a07 Jul 06 18:20:02.627721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.627629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:02.627721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.627695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:02.627721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.627715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627816 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627846 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627864 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.627898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627915 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.627895076 +0000 UTC m=+37.705970998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627949 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.627938945 +0000 UTC m=+37.706014870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.627969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.627977 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.628020 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.628003488 +0000 UTC m=+37.706079402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:02.628077 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:02.628066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:02.628423 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.628100 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:02.628423 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.628125 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.628107235 +0000 UTC m=+37.706183162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:02.628423 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.628147 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.628136552 +0000 UTC m=+37.706212466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:02.628423 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:02.628172 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:03.628158136 +0000 UTC m=+37.706234064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:03.047468 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.047422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:03.307559 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.306878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:20:03.308479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.308018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:03.310258 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.310231 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 18:20:03.310553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.310538 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 18:20:03.311661 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.311640 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgvgt\"" Jul 06 18:20:03.528997 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.528875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" event={"ID":"5e45e6e1-bb7b-407f-a75a-697c16d3f155","Type":"ContainerStarted","Data":"45a527bf5c1bdae4294129545c1158f1964c26038623fc7f0a4cb6a3587dcc21"} Jul 06 18:20:03.531174 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.531073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" event={"ID":"42c61b44-fb83-4c62-be09-5aa4f451601f","Type":"ContainerStarted","Data":"c1b9671fe8db566fdc2bb3c8e0c00c267ade6d5d240f8b98604e5a80687ff623"} Jul 06 18:20:03.537821 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.537653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:03.538482 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.538050 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:03.538482 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.538070 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:03.538482 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.538134 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.538111249 +0000 UTC m=+39.616187177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:03.545163 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.545033 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95jw2" event={"ID":"6c5f36f3-6e1e-4c18-8031-8fde16839bf7","Type":"ContainerStarted","Data":"ef730673443f9f9c1bbdf969a4587367d695839f79aacf724fe00c2904991a07"} Jul 06 18:20:03.549577 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.549492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" event={"ID":"bfa4577c-9130-43c7-97f7-15c4a5ce3649","Type":"ContainerStarted","Data":"13e0b03b185d1dabeb08f30419a744d5339bc6877a3137c931057eae7c9eca8d"} Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:03.639750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.639905 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.639969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.639949736 +0000 UTC m=+39.718025668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640400 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640446 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.640431849 +0000 UTC m=+39.718507782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640522 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.640510658 +0000 UTC m=+39.718586587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640586 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640620 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.640608639 +0000 UTC m=+39.718684557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640676 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:03.640867 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640706 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.640695857 +0000 UTC m=+39.718771772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:03.642066 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640759 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:03.642066 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:03.640809 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:05.640780112 +0000 UTC m=+39.718856031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:05.563284 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.563193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:05.563777 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.563366 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:05.563777 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.563393 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:05.563777 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.563466 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.563443681 +0000 UTC m=+43.641519598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:05.664364 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:05.664553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:05.664553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:05.664553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:05.664553 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664492 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:05.664553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:05.664834 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664567 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.664546012 +0000 UTC m=+43.742621932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:05.664834 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:05.664621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:05.664834 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664763 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.664749154 +0000 UTC m=+43.742825085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:05.664834 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664764 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:05.664834 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664818 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.664807578 +0000 UTC m=+43.742883505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:05.665085 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.664837 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:05.665085 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.665002 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.664983693 +0000 UTC m=+43.743059611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:05.665085 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.665060 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:05.665228 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.665091 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.665080122 +0000 UTC m=+43.743156041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:05.665228 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.665207 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:05.665333 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:05.665241 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:09.665231814 +0000 UTC m=+43.743307733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:06.797641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:06.797587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:07.077308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:07.077215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:07.180719 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:07.180674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:07.230803 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:07.230720 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:09.198876 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.198837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:20:09.202917 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.202885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1ead76-3dde-431e-b231-34ffcc6e7578-original-pull-secret\") pod \"global-pull-secret-syncer-s8mnz\" (UID: \"cf1ead76-3dde-431e-b231-34ffcc6e7578\") " pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:20:09.326371 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.326331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8mnz" Jul 06 18:20:09.602662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.602634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:09.602803 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.602754 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:09.602803 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.602766 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:09.602880 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.602835 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.602818461 +0000 UTC m=+51.680894374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:09.703429 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:09.703627 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:09.703627 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703546 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:09.703627 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703550 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:09.703627 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:09.703627 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703625 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.703604456 +0000 UTC m=+51.781680378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703689 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703697 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.703663116 +0000 UTC m=+51.781739032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703755 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.703738464 +0000 UTC m=+51.781814393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:09.703932 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:09.703898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:09.704167 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703948 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:09.704167 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703978 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:09.704167 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.703994 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.703980847 +0000 UTC m=+51.782056771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:09.704167 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.704013 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.704000249 +0000 UTC m=+51.782076165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:09.704167 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:09.704032 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:17.704023211 +0000 UTC m=+51.782099131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:12.959507 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:12.959478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8mnz"] Jul 06 18:20:12.962039 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:12.962010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1ead76_3dde_431e_b231_34ffcc6e7578.slice/crio-0754f08c9ebc05e52aee405709f53de97ed663d7f8f9d6b08b5f3feca6ca16a4 WatchSource:0}: Error finding container 0754f08c9ebc05e52aee405709f53de97ed663d7f8f9d6b08b5f3feca6ca16a4: Status 404 returned error can't find the container with id 0754f08c9ebc05e52aee405709f53de97ed663d7f8f9d6b08b5f3feca6ca16a4 Jul 06 18:20:13.582777 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.582682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95jw2" event={"ID":"6c5f36f3-6e1e-4c18-8031-8fde16839bf7","Type":"ContainerStarted","Data":"2d7bb16274f8a66c3223b7e33180f15153f4014f9d31a243c98ff91b1d6773d5"} Jul 06 18:20:13.584365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.584337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" event={"ID":"bfa4577c-9130-43c7-97f7-15c4a5ce3649","Type":"ContainerStarted","Data":"ea6a810f83862a37ecd77998793cef66ad5387ac785c8ca29451bda7dc3b1778"} Jul 06 18:20:13.587637 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.587610 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="ed16cb2d24d86d6f793ead0fcdb783a1af24d857722a8c36f0035a2ed4d862ac" exitCode=0 Jul 06 18:20:13.587753 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.587688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"ed16cb2d24d86d6f793ead0fcdb783a1af24d857722a8c36f0035a2ed4d862ac"} Jul 06 18:20:13.589563 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.589540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" event={"ID":"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56","Type":"ContainerStarted","Data":"d62f3c5dd9befa308619cd88eebe54579ba228a3f912210188a32c8afb564f81"} Jul 06 18:20:13.591381 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.591362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" event={"ID":"4368953e-2c4f-4f8f-acbe-dfa035dbbb8d","Type":"ContainerStarted","Data":"6a4cdf1edde9956882c5047f4827dd9e6dce8189089dc088c7a0557846f18074"} Jul 06 18:20:13.593218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.593199 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/0.log" Jul 06 18:20:13.593277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.593235 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e45e6e1-bb7b-407f-a75a-697c16d3f155" containerID="395fca228f50afe64a5b218af851f6cc6a29f1610a9478ad6204e8dcfb44656d" exitCode=255 Jul 06 18:20:13.593333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.593297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" event={"ID":"5e45e6e1-bb7b-407f-a75a-697c16d3f155","Type":"ContainerDied","Data":"395fca228f50afe64a5b218af851f6cc6a29f1610a9478ad6204e8dcfb44656d"} Jul 06 18:20:13.593562 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.593548 2574 scope.go:117] "RemoveContainer" containerID="395fca228f50afe64a5b218af851f6cc6a29f1610a9478ad6204e8dcfb44656d" Jul 06 18:20:13.595303 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.595281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" event={"ID":"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e","Type":"ContainerStarted","Data":"f7c98959743c380183b7e6a953f60caeebd3465f03cb9ce80d6cdf2120e06723"} Jul 06 18:20:13.597604 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.597579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" event={"ID":"42c61b44-fb83-4c62-be09-5aa4f451601f","Type":"ContainerStarted","Data":"5fd68ab95c35ea249c733c738175f5e100d3ba728ae1120d24b8c80324729074"} Jul 06 18:20:13.598767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.598746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8mnz" event={"ID":"cf1ead76-3dde-431e-b231-34ffcc6e7578","Type":"ContainerStarted","Data":"0754f08c9ebc05e52aee405709f53de97ed663d7f8f9d6b08b5f3feca6ca16a4"} Jul 06 18:20:13.602265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.602224 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-95jw2" podStartSLOduration=2.332992282 podStartE2EDuration="12.602211788s" totalImagesPullingTime="10.269219506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.601021966 +0000 UTC m=+47.679097903" watchObservedRunningTime="2026-07-06 18:20:13.602211788 +0000 UTC m=+47.680287724" Jul 06 18:20:13.641858 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.641803 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" podStartSLOduration=32.345360657 podStartE2EDuration="42.641764218s" totalImagesPullingTime="10.296403561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.620064085 +0000 UTC m=+47.698140027" watchObservedRunningTime="2026-07-06 18:20:13.641764218 +0000 UTC m=+47.719840152" Jul 06 18:20:13.664098 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.661959 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fzkb5" podStartSLOduration=32.365361098 podStartE2EDuration="42.661924675s" totalImagesPullingTime="10.296563577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.660427737 +0000 UTC m=+47.738503666" watchObservedRunningTime="2026-07-06 18:20:13.661924675 +0000 UTC m=+47.740000611" Jul 06 18:20:13.664098 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.662758 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rstrk" podStartSLOduration=32.384236694 podStartE2EDuration="42.662748516s" totalImagesPullingTime="10.278511822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.642541577 +0000 UTC m=+47.720617514" watchObservedRunningTime="2026-07-06 18:20:13.662748516 +0000 UTC m=+47.740824452" Jul 06 18:20:13.725333 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:13.725278 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" podStartSLOduration=32.364213807 podStartE2EDuration="42.725256571s" totalImagesPullingTime="10.361042764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.723962878 +0000 UTC m=+47.802038855" watchObservedRunningTime="2026-07-06 18:20:13.725256571 +0000 UTC m=+47.803332509" Jul 06 18:20:14.433331 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.432326 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" podStartSLOduration=33.122608416 podStartE2EDuration="43.432301496s" totalImagesPullingTime="10.30969308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:13.746277736 +0000 UTC m=+47.824353667" watchObservedRunningTime="2026-07-06 18:20:14.432301496 +0000 UTC m=+48.510377435" Jul 06 18:20:14.434710 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.434157 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pkkcw"] Jul 06 18:20:14.452574 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.451685 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkkcw"] Jul 06 18:20:14.452574 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.451873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.455279 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.454983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 18:20:14.455279 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.455003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7c2d\"" Jul 06 18:20:14.455279 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.455266 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 18:20:14.553700 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.553658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.553922 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.553745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-data-volume\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.553922 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.553892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzxz\" (UniqueName: \"kubernetes.io/projected/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-api-access-4gzxz\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.554098 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.553957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-crio-socket\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.554098 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.554000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.608940 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.608904 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2ff7848-bd32-43d5-a0ab-53c117a23188" containerID="dfc0300265bd479a66a3a3c03aea323a86e3b1db872fdfed78bbc3840ed4356a" exitCode=0 Jul 06 18:20:14.609264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.609242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerDied","Data":"dfc0300265bd479a66a3a3c03aea323a86e3b1db872fdfed78bbc3840ed4356a"} Jul 06 18:20:14.612052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.612022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:20:14.612525 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.612460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/0.log" Jul 06 18:20:14.612845 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.612499 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e45e6e1-bb7b-407f-a75a-697c16d3f155" containerID="5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e" exitCode=255 Jul 06 18:20:14.612845 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.612772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" event={"ID":"5e45e6e1-bb7b-407f-a75a-697c16d3f155","Type":"ContainerDied","Data":"5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e"} Jul 06 18:20:14.612991 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.612858 2574 scope.go:117] "RemoveContainer" containerID="395fca228f50afe64a5b218af851f6cc6a29f1610a9478ad6204e8dcfb44656d" Jul 06 18:20:14.614182 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.613070 2574 scope.go:117] "RemoveContainer" containerID="5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e" Jul 06 18:20:14.614182 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:14.613249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-54qvj_openshift-console-operator(5e45e6e1-bb7b-407f-a75a-697c16d3f155)\"" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" podUID="5e45e6e1-bb7b-407f-a75a-697c16d3f155" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.655404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzxz\" (UniqueName: \"kubernetes.io/projected/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-api-access-4gzxz\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.655455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-crio-socket\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.655485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.655569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.655624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-data-volume\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.656678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-crio-socket\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:14.656807 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:14.656880 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:15.156858598 +0000 UTC m=+49.234934516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : secret "insights-runtime-extractor-tls" not found Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:14.657103 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:14.657149 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:15.157134331 +0000 UTC m=+49.235210259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : configmap "kube-rbac-proxy" not found Jul 06 18:20:14.661148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.660635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-data-volume\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:14.677952 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:14.677916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzxz\" (UniqueName: \"kubernetes.io/projected/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-api-access-4gzxz\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:15.162049 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.162005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:15.162248 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:15.162145 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:20:15.162248 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.162185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:15.162248 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:15.162216 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:16.162194983 +0000 UTC m=+50.240270897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : configmap "kube-rbac-proxy" not found Jul 06 18:20:15.162424 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:15.162316 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:20:15.162424 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:15.162365 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:16.162350555 +0000 UTC m=+50.240426485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : secret "insights-runtime-extractor-tls" not found Jul 06 18:20:15.624147 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.624044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" event={"ID":"b2ff7848-bd32-43d5-a0ab-53c117a23188","Type":"ContainerStarted","Data":"3f85555191d2b04d246b14bb54ed52cdb100c9b40f5c186b190fd33c36512408"} Jul 06 18:20:15.625591 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.625571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:20:15.625872 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.625858 2574 scope.go:117] "RemoveContainer" containerID="5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e" Jul 06 18:20:15.626014 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:15.625992 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-54qvj_openshift-console-operator(5e45e6e1-bb7b-407f-a75a-697c16d3f155)\"" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" podUID="5e45e6e1-bb7b-407f-a75a-697c16d3f155" Jul 06 18:20:15.646637 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.646585 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p9gbv" podStartSLOduration=8.421314317 podStartE2EDuration="48.64656932s" totalImagesPullingTime="40.225255003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:15.644495155 +0000 UTC m=+49.722571092" watchObservedRunningTime="2026-07-06 18:20:15.64656932 +0000 UTC m=+49.724645256" Jul 06 18:20:15.828603 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:15.828574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvxk2_98dde2d6-8c6b-47b6-836a-77fdcc21cec6/dns-node-resolver/0.log" Jul 06 18:20:16.171528 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:16.171490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:16.171727 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:16.171593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:16.171727 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:16.171655 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:20:16.171727 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:16.171674 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 18:20:16.171913 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:16.171740 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:18.171719598 +0000 UTC m=+52.249795527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : secret "insights-runtime-extractor-tls" not found Jul 06 18:20:16.171913 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:16.171759 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:18.171751076 +0000 UTC m=+52.249826993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : configmap "kube-rbac-proxy" not found Jul 06 18:20:16.835838 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:16.835807 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8k9w4_a4b39dbf-4482-4fc9-9e6e-48bea8305aa2/node-ca/0.log" Jul 06 18:20:17.687368 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.687319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:17.687549 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.687479 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 18:20:17.687549 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.687505 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-988b5849-rbkdc: secret "image-registry-tls" not found Jul 06 18:20:17.687636 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.687568 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls podName:026a8fc3-5789-469e-8f53-cc9955beb6f7 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.687550292 +0000 UTC m=+67.765626209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls") pod "image-registry-988b5849-rbkdc" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7") : secret "image-registry-tls" not found Jul 06 18:20:17.788804 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:17.788994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:17.788994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:17.788994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:17.788994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:17.788994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.788980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.788923 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789020 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789006 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789074 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789085 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls podName:d5b86957-9567-47c7-89b5-d8bbe146942e nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.789063965 +0000 UTC m=+67.867139884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nqxrg" (UID: "d5b86957-9567-47c7-89b5-d8bbe146942e") : secret "cluster-monitoring-operator-tls" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789105 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.789094618 +0000 UTC m=+67.867170532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : secret "router-metrics-certs-default" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789123 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert podName:11cf91b7-382e-4b5e-ba7a-2c77bb189225 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.789112304 +0000 UTC m=+67.867188221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cgj92" (UID: "11cf91b7-382e-4b5e-ba7a-2c77bb189225") : secret "networking-console-plugin-cert" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789006 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 18:20:17.789240 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789138 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle podName:3d9bd0df-c5ad-4e06-af60-5810eacd4801 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.78913023 +0000 UTC m=+67.867206148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle") pod "router-default-5f6df67dcf-4vpzr" (UID: "3d9bd0df-c5ad-4e06-af60-5810eacd4801") : configmap references non-existent config key: service-ca.crt Jul 06 18:20:17.789647 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789490 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls podName:352c0f19-8001-4609-a035-dfa6a9870099 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.789454547 +0000 UTC m=+67.867530476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls") pod "dns-default-dwp97" (UID: "352c0f19-8001-4609-a035-dfa6a9870099") : secret "dns-default-metrics-tls" not found Jul 06 18:20:17.789717 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:17.789699 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls podName:d9931666-f427-4ab5-8cfc-256777022f89 nodeName:}" failed. No retries permitted until 2026-07-06 18:20:33.789679508 +0000 UTC m=+67.867755436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zdp8n" (UID: "d9931666-f427-4ab5-8cfc-256777022f89") : secret "samples-operator-tls" not found Jul 06 18:20:17.828938 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:17.828899 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95jw2_6c5f36f3-6e1e-4c18-8031-8fde16839bf7/serve-healthcheck-canary/0.log" Jul 06 18:20:18.192979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:18.192940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:18.193476 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:18.193043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:18.193476 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:18.193125 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:20:18.193476 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:18.193228 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:22.193204675 +0000 UTC m=+56.271280603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : secret "insights-runtime-extractor-tls" not found Jul 06 18:20:18.193740 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:18.193716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:18.638079 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:18.637993 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8mnz" event={"ID":"cf1ead76-3dde-431e-b231-34ffcc6e7578","Type":"ContainerStarted","Data":"1015b3ee759399911bb44e8d34c9979704e637a1b3f1215ba692e1f833e6dd65"} Jul 06 18:20:18.655215 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:18.655163 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s8mnz" podStartSLOduration=36.320336651 podStartE2EDuration="41.65514304s" totalImagesPullingTime="5.334806389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:18.65513474 +0000 UTC m=+52.733210676" watchObservedRunningTime="2026-07-06 18:20:18.65514304 +0000 UTC m=+52.733218975" Jul 06 18:20:22.231878 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:22.231838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:22.232424 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:22.231964 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 18:20:22.232424 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:22.232016 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls podName:f29bd5a6-e0c4-453c-89af-a46e8a04b2bb nodeName:}" failed. No retries permitted until 2026-07-06 18:20:30.232003584 +0000 UTC m=+64.310079501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkkcw" (UID: "f29bd5a6-e0c4-453c-89af-a46e8a04b2bb") : secret "insights-runtime-extractor-tls" not found Jul 06 18:20:22.313953 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:22.313910 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:22.314120 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:22.313968 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:22.314339 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:22.314328 2574 scope.go:117] "RemoveContainer" containerID="5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e" Jul 06 18:20:22.314493 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:20:22.314475 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-54qvj_openshift-console-operator(5e45e6e1-bb7b-407f-a75a-697c16d3f155)\"" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" podUID="5e45e6e1-bb7b-407f-a75a-697c16d3f155" Jul 06 18:20:27.506011 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:27.505981 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-96ghh" Jul 06 18:20:30.306956 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.306915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:30.309249 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.309225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29bd5a6-e0c4-453c-89af-a46e8a04b2bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkkcw\" (UID: \"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb\") " pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:30.366892 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.366857 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7c2d\"" Jul 06 18:20:30.374103 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.374074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkkcw" Jul 06 18:20:30.531592 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.531438 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkkcw"] Jul 06 18:20:30.534246 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:30.534203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29bd5a6_e0c4_453c_89af_a46e8a04b2bb.slice/crio-348f3f6cd6a92be44661572ed02a9fe7e4f05d5f485d3caaf35bffa372c9cd8c WatchSource:0}: Error finding container 348f3f6cd6a92be44661572ed02a9fe7e4f05d5f485d3caaf35bffa372c9cd8c: Status 404 returned error can't find the container with id 348f3f6cd6a92be44661572ed02a9fe7e4f05d5f485d3caaf35bffa372c9cd8c Jul 06 18:20:30.673712 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:30.673674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkkcw" event={"ID":"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb","Type":"ContainerStarted","Data":"348f3f6cd6a92be44661572ed02a9fe7e4f05d5f485d3caaf35bffa372c9cd8c"} Jul 06 18:20:32.023022 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.022977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:32.025802 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.025765 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 18:20:32.036559 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.036530 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820edf78-8707-43e8-a69c-bdd9f411978f-metrics-certs\") pod \"network-metrics-daemon-lk6bh\" (UID: \"820edf78-8707-43e8-a69c-bdd9f411978f\") " pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:32.123672 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.123636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:32.126461 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.126441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wjmk\" (UniqueName: \"kubernetes.io/projected/649474d8-eaed-4431-b89e-ff57e0d4dfe8-kube-api-access-5wjmk\") pod \"network-check-target-cs5mt\" (UID: \"649474d8-eaed-4431-b89e-ff57e0d4dfe8\") " pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:32.135964 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.135938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgvgt\"" Jul 06 18:20:32.144330 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.144295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk6bh" Jul 06 18:20:32.332626 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.332540 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpmrs\"" Jul 06 18:20:32.339959 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:32.339930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:33.307481 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.307451 2574 scope.go:117] "RemoveContainer" containerID="5d1fdbb1f01e85b0c3d58dbead01fefd96bad90c3c85c718de1b7797d193080e" Jul 06 18:20:33.741511 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.741474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:33.744153 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.744128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"image-registry-988b5849-rbkdc\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:33.842144 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:33.842144 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:33.842395 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:33.842395 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:33.842395 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:33.842395 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:33.843010 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.842954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9bd0df-c5ad-4e06-af60-5810eacd4801-service-ca-bundle\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:33.845519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.845478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352c0f19-8001-4609-a035-dfa6a9870099-metrics-tls\") pod \"dns-default-dwp97\" (UID: \"352c0f19-8001-4609-a035-dfa6a9870099\") " pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:33.845691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.845670 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9931666-f427-4ab5-8cfc-256777022f89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zdp8n\" (UID: \"d9931666-f427-4ab5-8cfc-256777022f89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:33.845745 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.845728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9bd0df-c5ad-4e06-af60-5810eacd4801-metrics-certs\") pod \"router-default-5f6df67dcf-4vpzr\" (UID: \"3d9bd0df-c5ad-4e06-af60-5810eacd4801\") " pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:33.846023 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.845981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5b86957-9567-47c7-89b5-d8bbe146942e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nqxrg\" (UID: \"d5b86957-9567-47c7-89b5-d8bbe146942e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:33.846023 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.846002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11cf91b7-382e-4b5e-ba7a-2c77bb189225-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cgj92\" (UID: \"11cf91b7-382e-4b5e-ba7a-2c77bb189225\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:33.985907 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.985873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h42sk\"" Jul 06 18:20:33.993192 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:33.993106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:34.030694 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.030662 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnzkz\"" Jul 06 18:20:34.038908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.038879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:34.049557 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.049533 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9s8rc\"" Jul 06 18:20:34.057138 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.057113 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" Jul 06 18:20:34.059928 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.059904 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9wdv2\"" Jul 06 18:20:34.068363 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.068336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:34.073553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.073531 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-28vl6\"" Jul 06 18:20:34.081777 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.081755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" Jul 06 18:20:34.096778 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.096749 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8zhh\"" Jul 06 18:20:34.104959 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.104926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" Jul 06 18:20:34.356205 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.353561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cs5mt"] Jul 06 18:20:34.410125 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.409899 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk6bh"] Jul 06 18:20:34.411381 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:34.410304 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820edf78_8707_43e8_a69c_bdd9f411978f.slice/crio-181a142a03ad144fd888cbcdc5fb6962a842c64c8aa7b7cc2ae20db27be01041 WatchSource:0}: Error finding container 181a142a03ad144fd888cbcdc5fb6962a842c64c8aa7b7cc2ae20db27be01041: Status 404 returned error can't find the container with id 181a142a03ad144fd888cbcdc5fb6962a842c64c8aa7b7cc2ae20db27be01041 Jul 06 18:20:34.427508 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.424918 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f6df67dcf-4vpzr"] Jul 06 18:20:34.500091 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.500054 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dwp97"] Jul 06 18:20:34.508404 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:34.507747 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352c0f19_8001_4609_a035_dfa6a9870099.slice/crio-7e469c4c110657b71e3794583de4b4765a5b3ec1dd4cb975e5f0bf2241b37897 WatchSource:0}: Error finding container 7e469c4c110657b71e3794583de4b4765a5b3ec1dd4cb975e5f0bf2241b37897: Status 404 returned error can't find the container with id 7e469c4c110657b71e3794583de4b4765a5b3ec1dd4cb975e5f0bf2241b37897 Jul 06 18:20:34.515902 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.515873 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cgj92"] Jul 06 18:20:34.520060 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:34.520019 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cf91b7_382e_4b5e_ba7a_2c77bb189225.slice/crio-9f7d0395e038afdddde29436584be8c6d7fc58bb5ac6ab4347ec3e5054905004 WatchSource:0}: Error finding container 9f7d0395e038afdddde29436584be8c6d7fc58bb5ac6ab4347ec3e5054905004: Status 404 returned error can't find the container with id 9f7d0395e038afdddde29436584be8c6d7fc58bb5ac6ab4347ec3e5054905004 Jul 06 18:20:34.542197 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.542119 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg"] Jul 06 18:20:34.547159 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:34.547010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b86957_9567_47c7_89b5_d8bbe146942e.slice/crio-856553cfff3b851222240f4660edcdedcd895c774b080817e4341f43b11301fa WatchSource:0}: Error finding container 856553cfff3b851222240f4660edcdedcd895c774b080817e4341f43b11301fa: Status 404 returned error can't find the container with id 856553cfff3b851222240f4660edcdedcd895c774b080817e4341f43b11301fa Jul 06 18:20:34.560339 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.560297 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n"] Jul 06 18:20:34.565369 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.564914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:20:34.568812 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:34.568766 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026a8fc3_5789_469e_8f53_cc9955beb6f7.slice/crio-de1c86be854c4e308a95eb4c9b4ffc301b0c1347a6da3f8cc7178a739745e50e WatchSource:0}: Error finding container de1c86be854c4e308a95eb4c9b4ffc301b0c1347a6da3f8cc7178a739745e50e: Status 404 returned error can't find the container with id de1c86be854c4e308a95eb4c9b4ffc301b0c1347a6da3f8cc7178a739745e50e Jul 06 18:20:34.690837 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.690811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:20:34.691121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.690901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" event={"ID":"5e45e6e1-bb7b-407f-a75a-697c16d3f155","Type":"ContainerStarted","Data":"00c29b3decde6b541b40eb12496b7c7c1529d57bc8864dc64f0f4705d95075dd"} Jul 06 18:20:34.691424 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.691405 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:34.692553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.692525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" event={"ID":"d9931666-f427-4ab5-8cfc-256777022f89","Type":"ContainerStarted","Data":"6f0ee1c220e4ecdc8e56990f9cc83552cab69112103e357246164662fc660b26"} Jul 06 18:20:34.694597 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.694559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkkcw" event={"ID":"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb","Type":"ContainerStarted","Data":"a37b1f9e423dccb107522917f445991c9c4656319a692c702c0d6849c38c7804"} Jul 06 18:20:34.695850 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.695827 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" event={"ID":"d5b86957-9567-47c7-89b5-d8bbe146942e","Type":"ContainerStarted","Data":"856553cfff3b851222240f4660edcdedcd895c774b080817e4341f43b11301fa"} Jul 06 18:20:34.697737 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.697706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988b5849-rbkdc" event={"ID":"026a8fc3-5789-469e-8f53-cc9955beb6f7","Type":"ContainerStarted","Data":"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7"} Jul 06 18:20:34.697848 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.697751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988b5849-rbkdc" event={"ID":"026a8fc3-5789-469e-8f53-cc9955beb6f7","Type":"ContainerStarted","Data":"de1c86be854c4e308a95eb4c9b4ffc301b0c1347a6da3f8cc7178a739745e50e"} Jul 06 18:20:34.697922 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.697870 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:34.699040 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.699017 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwp97" event={"ID":"352c0f19-8001-4609-a035-dfa6a9870099","Type":"ContainerStarted","Data":"7e469c4c110657b71e3794583de4b4765a5b3ec1dd4cb975e5f0bf2241b37897"} Jul 06 18:20:34.700252 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.700230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk6bh" event={"ID":"820edf78-8707-43e8-a69c-bdd9f411978f","Type":"ContainerStarted","Data":"181a142a03ad144fd888cbcdc5fb6962a842c64c8aa7b7cc2ae20db27be01041"} Jul 06 18:20:34.702009 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.701983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cs5mt" event={"ID":"649474d8-eaed-4431-b89e-ff57e0d4dfe8","Type":"ContainerStarted","Data":"7266ef286a4afcb43b44886e68d90603d30e3a186be2efe109c4c5edbeb6126d"} Jul 06 18:20:34.702108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.702030 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:20:34.702108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.702049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cs5mt" event={"ID":"649474d8-eaed-4431-b89e-ff57e0d4dfe8","Type":"ContainerStarted","Data":"44f46208141f714559a9688e372edad0cb78c733c387acefd73edaaaf066592c"} Jul 06 18:20:34.703668 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.703642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" event={"ID":"11cf91b7-382e-4b5e-ba7a-2c77bb189225","Type":"ContainerStarted","Data":"9f7d0395e038afdddde29436584be8c6d7fc58bb5ac6ab4347ec3e5054905004"} Jul 06 18:20:34.705264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.705244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" event={"ID":"3d9bd0df-c5ad-4e06-af60-5810eacd4801","Type":"ContainerStarted","Data":"35658c3e90a3b9cc9c683121d19173ef0d5ac0ea95105e97d8b50b8c6e907a70"} Jul 06 18:20:34.705357 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.705280 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" event={"ID":"3d9bd0df-c5ad-4e06-af60-5810eacd4801","Type":"ContainerStarted","Data":"f1f08db31b6fa1f145b2d30e3e4880d3e321a274c16facb685b36a2b7c819996"} Jul 06 18:20:34.709738 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.709691 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" podStartSLOduration=53.413329725 podStartE2EDuration="1m3.709680239s" totalImagesPullingTime="10.296350514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:34.709208987 +0000 UTC m=+68.787284926" watchObservedRunningTime="2026-07-06 18:20:34.709680239 +0000 UTC m=+68.787756153" Jul 06 18:20:34.726657 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.726599 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" podStartSLOduration=63.726582349 podStartE2EDuration="1m3.726582349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:34.726434648 +0000 UTC m=+68.804510606" watchObservedRunningTime="2026-07-06 18:20:34.726582349 +0000 UTC m=+68.804658285" Jul 06 18:20:34.742996 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.742916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cs5mt" podStartSLOduration=67.742896411 podStartE2EDuration="1m7.742896411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:34.741223781 +0000 UTC m=+68.819299738" watchObservedRunningTime="2026-07-06 18:20:34.742896411 +0000 UTC m=+68.820972348" Jul 06 18:20:34.764996 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:34.764891 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-988b5849-rbkdc" podStartSLOduration=67.764870269 podStartE2EDuration="1m7.764870269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:34.764088157 +0000 UTC m=+68.842164113" watchObservedRunningTime="2026-07-06 18:20:34.764870269 +0000 UTC m=+68.842946207" Jul 06 18:20:35.040090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.039927 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:35.042458 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.042428 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:35.087781 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.087718 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-54qvj" Jul 06 18:20:35.725001 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.723585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkkcw" event={"ID":"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb","Type":"ContainerStarted","Data":"1686a3a20f6e80a4a3ab19ac228ccae8c29442a8a326a4f005e4742ff5e95c92"} Jul 06 18:20:35.725001 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.723656 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:35.726651 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:35.726439 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f6df67dcf-4vpzr" Jul 06 18:20:36.083709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.082409 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-j9cqz"] Jul 06 18:20:36.086801 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.086018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:36.090348 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.089671 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8m6fl\"" Jul 06 18:20:36.090348 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.089958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 18:20:36.090348 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.090182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 18:20:36.106993 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.106966 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-j9cqz"] Jul 06 18:20:36.174809 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.174124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccll2\" (UniqueName: \"kubernetes.io/projected/bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2-kube-api-access-ccll2\") pod \"downloads-685bfb5f64-j9cqz\" (UID: \"bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2\") " pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:36.274671 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.274631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccll2\" (UniqueName: \"kubernetes.io/projected/bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2-kube-api-access-ccll2\") pod \"downloads-685bfb5f64-j9cqz\" (UID: \"bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2\") " pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:36.294482 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.294411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccll2\" (UniqueName: \"kubernetes.io/projected/bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2-kube-api-access-ccll2\") pod \"downloads-685bfb5f64-j9cqz\" (UID: \"bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2\") " pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:36.406170 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.406013 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:36.731889 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.731255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk6bh" event={"ID":"820edf78-8707-43e8-a69c-bdd9f411978f","Type":"ContainerStarted","Data":"ae5a2598cc235ede12fe7783ccc884ddaeae37c3986f81947f2fcb3ae1bafef4"} Jul 06 18:20:36.731889 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.731321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk6bh" event={"ID":"820edf78-8707-43e8-a69c-bdd9f411978f","Type":"ContainerStarted","Data":"301b3ef8ff69195a52af63ed3b0d5024d7e97e7bd285fd207bee308b8631f972"} Jul 06 18:20:36.749915 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:36.749855 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lk6bh" podStartSLOduration=68.596952048 podStartE2EDuration="1m9.749831416s" totalImagesPullingTime="1.152879368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:36.749372208 +0000 UTC m=+70.827448167" watchObservedRunningTime="2026-07-06 18:20:36.749831416 +0000 UTC m=+70.827907354" Jul 06 18:20:39.237446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.237303 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-j9cqz"] Jul 06 18:20:39.241965 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:39.241924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffb6cc0_5be9_4bf9_a42d_4a6c8f8e33c2.slice/crio-0e8166c23eff929aa4edbf935680ecac7cd9dddb27cec0a76fcac402aad24e35 WatchSource:0}: Error finding container 0e8166c23eff929aa4edbf935680ecac7cd9dddb27cec0a76fcac402aad24e35: Status 404 returned error can't find the container with id 0e8166c23eff929aa4edbf935680ecac7cd9dddb27cec0a76fcac402aad24e35 Jul 06 18:20:39.748678 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.748634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-j9cqz" event={"ID":"bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2","Type":"ContainerStarted","Data":"0e8166c23eff929aa4edbf935680ecac7cd9dddb27cec0a76fcac402aad24e35"} Jul 06 18:20:39.750958 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.750925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwp97" event={"ID":"352c0f19-8001-4609-a035-dfa6a9870099","Type":"ContainerStarted","Data":"8bdb1ea581966b2f837d06fbe276c21c934b8201456034ba49239963d9d69660"} Jul 06 18:20:39.751193 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.751167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwp97" event={"ID":"352c0f19-8001-4609-a035-dfa6a9870099","Type":"ContainerStarted","Data":"b3d0d80a16356170581eaa968d6d608fa66ae6c5f5059a9a8f7de6fa7d54a9e6"} Jul 06 18:20:39.751832 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.751503 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:39.754008 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.753970 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" event={"ID":"11cf91b7-382e-4b5e-ba7a-2c77bb189225","Type":"ContainerStarted","Data":"abe42083dfa5cb85c4ade1420000f761dbc2691dfd7ef0b81431701d01baedfb"} Jul 06 18:20:39.756825 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.756779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkkcw" event={"ID":"f29bd5a6-e0c4-453c-89af-a46e8a04b2bb","Type":"ContainerStarted","Data":"a05b499a8d3979bde573a8785364de283aa852b361cbcc719645f123a9bfe760"} Jul 06 18:20:39.758839 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.758765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" event={"ID":"d5b86957-9567-47c7-89b5-d8bbe146942e","Type":"ContainerStarted","Data":"35139d4a133b835c54a17f50be8c28fed9e7043a3fd3409ce667581bb9f5d866"} Jul 06 18:20:39.760742 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.760718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" event={"ID":"d9931666-f427-4ab5-8cfc-256777022f89","Type":"ContainerStarted","Data":"38b7cbffcdbd108173356a8b25988ca9fa54d605da419696c70dc120fe23a573"} Jul 06 18:20:39.760853 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.760766 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" event={"ID":"d9931666-f427-4ab5-8cfc-256777022f89","Type":"ContainerStarted","Data":"1a9dda638ebb9ef99ca2f3bb5ea38ac02aa3b61d4820e6a88b4ef76402e6fcd2"} Jul 06 18:20:39.772187 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.772125 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dwp97" podStartSLOduration=34.221484803 podStartE2EDuration="38.772106325s" totalImagesPullingTime="4.550621522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:39.769525054 +0000 UTC m=+73.847600992" watchObservedRunningTime="2026-07-06 18:20:39.772106325 +0000 UTC m=+73.850182262" Jul 06 18:20:39.786217 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.786163 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nqxrg" podStartSLOduration=64.276251402 podStartE2EDuration="1m8.786144676s" totalImagesPullingTime="4.509893274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:39.784875772 +0000 UTC m=+73.862951727" watchObservedRunningTime="2026-07-06 18:20:39.786144676 +0000 UTC m=+73.864220612" Jul 06 18:20:39.803910 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.803851 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zdp8n" podStartSLOduration=64.354956383 podStartE2EDuration="1m8.803830616s" totalImagesPullingTime="4.448874233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:39.802021024 +0000 UTC m=+73.880096985" watchObservedRunningTime="2026-07-06 18:20:39.803830616 +0000 UTC m=+73.881906552" Jul 06 18:20:39.822035 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.821974 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pkkcw" podStartSLOduration=17.51877862 podStartE2EDuration="25.821954606s" totalImagesPullingTime="8.303175986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:20:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:39.821913522 +0000 UTC m=+73.899989479" watchObservedRunningTime="2026-07-06 18:20:39.821954606 +0000 UTC m=+73.900030546" Jul 06 18:20:39.841926 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:39.841871 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cgj92" podStartSLOduration=52.307756342 podStartE2EDuration="56.841849967s" totalImagesPullingTime="4.534093625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:39.841479028 +0000 UTC m=+73.919554993" watchObservedRunningTime="2026-07-06 18:20:39.841849967 +0000 UTC m=+73.919925903" Jul 06 18:20:49.768387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:49.768249 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dwp97" Jul 06 18:20:51.067698 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.067661 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pw2zb"] Jul 06 18:20:51.100238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.100211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.103095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.102985 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 18:20:51.103095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.103052 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 18:20:51.103392 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.103371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 18:20:51.104301 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.104280 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5f786\"" Jul 06 18:20:51.104301 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.104297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 18:20:51.207322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-root\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207515 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-textfile\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207515 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-wtmp\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207515 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-tls\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207678 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-metrics-client-ca\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207678 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsjns\" (UniqueName: \"kubernetes.io/projected/5aa39338-8d5d-48df-be18-44d4652d8485-kube-api-access-qsjns\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207678 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207818 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-sys\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.207818 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.207755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-accelerators-collector-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.308838 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-tls\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.308838 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-metrics-client-ca\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsjns\" (UniqueName: \"kubernetes.io/projected/5aa39338-8d5d-48df-be18-44d4652d8485-kube-api-access-qsjns\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308954 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-sys\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.308986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-accelerators-collector-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-root\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-textfile\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-wtmp\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-wtmp\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-root\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309368 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5aa39338-8d5d-48df-be18-44d4652d8485-sys\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309651 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-accelerators-collector-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309826 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-textfile\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.309914 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.309899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa39338-8d5d-48df-be18-44d4652d8485-metrics-client-ca\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.311546 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.311517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-tls\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.311692 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.311669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa39338-8d5d-48df-be18-44d4652d8485-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.318167 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.318108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsjns\" (UniqueName: \"kubernetes.io/projected/5aa39338-8d5d-48df-be18-44d4652d8485-kube-api-access-qsjns\") pod \"node-exporter-pw2zb\" (UID: \"5aa39338-8d5d-48df-be18-44d4652d8485\") " pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.412682 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.412650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pw2zb" Jul 06 18:20:51.438899 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:51.438866 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa39338_8d5d_48df_be18_44d4652d8485.slice/crio-1994cf401987a798e68ade3ff45f4451000f31d73173df97360418b43a1604c2 WatchSource:0}: Error finding container 1994cf401987a798e68ade3ff45f4451000f31d73173df97360418b43a1604c2: Status 404 returned error can't find the container with id 1994cf401987a798e68ade3ff45f4451000f31d73173df97360418b43a1604c2 Jul 06 18:20:51.812548 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:51.812510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pw2zb" event={"ID":"5aa39338-8d5d-48df-be18-44d4652d8485","Type":"ContainerStarted","Data":"1994cf401987a798e68ade3ff45f4451000f31d73173df97360418b43a1604c2"} Jul 06 18:20:53.998797 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:53.998757 2574 patch_prober.go:28] interesting pod/image-registry-988b5849-rbkdc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 18:20:53.999301 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:53.998834 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-988b5849-rbkdc" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:20:55.730329 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:55.730260 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:20:56.254410 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.254375 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84fdd57889-k8wdr"] Jul 06 18:20:56.257436 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.257415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.261227 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 18:20:56.261227 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261219 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 18:20:56.261418 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 18:20:56.261808 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-725bj\"" Jul 06 18:20:56.261808 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261670 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 18:20:56.261808 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.261675 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 18:20:56.267211 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.267188 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 18:20:56.273561 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.273533 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84fdd57889-k8wdr"] Jul 06 18:20:56.355998 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.355963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-federate-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-metrics-client-ca\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356392 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-serving-certs-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356392 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqp4\" (UniqueName: \"kubernetes.io/projected/3c9616ca-34cb-445d-8d68-95beec66ec51-kube-api-access-9xqp4\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.356392 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.356253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457237 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-federate-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-metrics-client-ca\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-serving-certs-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457680 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqp4\" (UniqueName: \"kubernetes.io/projected/3c9616ca-34cb-445d-8d68-95beec66ec51-kube-api-access-9xqp4\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.457680 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.457475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.458231 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.458155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-metrics-client-ca\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.458402 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.458370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.458717 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.458670 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c9616ca-34cb-445d-8d68-95beec66ec51-serving-certs-ca-bundle\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.460289 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.460259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.460493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.460470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.460565 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.460520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-telemeter-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.460621 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.460604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c9616ca-34cb-445d-8d68-95beec66ec51-federate-client-tls\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.466983 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.466959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqp4\" (UniqueName: \"kubernetes.io/projected/3c9616ca-34cb-445d-8d68-95beec66ec51-kube-api-access-9xqp4\") pod \"telemeter-client-84fdd57889-k8wdr\" (UID: \"3c9616ca-34cb-445d-8d68-95beec66ec51\") " pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:56.569371 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:56.569291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" Jul 06 18:20:57.266269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.266239 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:20:57.268924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.268898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.272026 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.272000 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 18:20:57.272207 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.272182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 18:20:57.272274 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.272208 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 18:20:57.273327 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273306 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 18:20:57.273414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273325 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 18:20:57.273414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273346 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 18:20:57.273539 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273330 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 18:20:57.273539 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273499 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-96nrucr1icfhp\"" Jul 06 18:20:57.273644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 18:20:57.273644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.273633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zq2dn\"" Jul 06 18:20:57.274876 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.274832 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 18:20:57.274876 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.274872 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 18:20:57.275129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.275091 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 18:20:57.275200 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.275150 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 18:20:57.275391 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.275372 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 18:20:57.275507 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.275484 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 18:20:57.276603 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.276575 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 18:20:57.291281 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.291253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:20:57.365848 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.365807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.365868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.365952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.365994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv4bz\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.366911 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.366541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.467880 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.467849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.467880 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.467885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.467910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.467936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.467980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468544 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468727 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468875 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.468875 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469006 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469006 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469006 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.468967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv4bz\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469426 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469483 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.469652 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.469628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.470265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.470244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.471831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.471844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.471848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.472040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.472144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472573 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.472554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472711 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.472669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.472905 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.472884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.473181 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.473136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.473993 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.473947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.474573 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.474547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.474753 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.474726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.475598 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.475575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.475689 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.475640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.482584 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.482557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv4bz\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz\") pod \"prometheus-k8s-0\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:57.581397 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:57.581307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:20:58.180480 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:58.180438 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:20:58.893711 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:58.893515 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84fdd57889-k8wdr"] Jul 06 18:20:58.897411 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:20:58.897381 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9616ca_34cb_445d_8d68_95beec66ec51.slice/crio-536b9735cbdd2d19e969c328c35e4d0d41e6d44fc131b302ee4604a048d37888 WatchSource:0}: Error finding container 536b9735cbdd2d19e969c328c35e4d0d41e6d44fc131b302ee4604a048d37888: Status 404 returned error can't find the container with id 536b9735cbdd2d19e969c328c35e4d0d41e6d44fc131b302ee4604a048d37888 Jul 06 18:20:58.918586 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:58.918476 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:20:59.852028 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.851850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-j9cqz" event={"ID":"bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2","Type":"ContainerStarted","Data":"3224e33231815ff173a97f9c82cbaa4c040005c3f04b399d213e3989c9e6fc29"} Jul 06 18:20:59.852580 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.852556 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:59.857912 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.857778 2574 generic.go:356] "Generic (PLEG): container finished" podID="5aa39338-8d5d-48df-be18-44d4652d8485" containerID="db563d0708b0c8e34d01ff5efb9bfe4a39895d8f105a1941b2a52dd154659d78" exitCode=0 Jul 06 18:20:59.857912 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.857893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pw2zb" event={"ID":"5aa39338-8d5d-48df-be18-44d4652d8485","Type":"ContainerDied","Data":"db563d0708b0c8e34d01ff5efb9bfe4a39895d8f105a1941b2a52dd154659d78"} Jul 06 18:20:59.859818 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.859774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"bfc6597089084afb4afbb4e5247ca305915635dbea96501fc56ff11742162710"} Jul 06 18:20:59.861893 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.861843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" event={"ID":"3c9616ca-34cb-445d-8d68-95beec66ec51","Type":"ContainerStarted","Data":"536b9735cbdd2d19e969c328c35e4d0d41e6d44fc131b302ee4604a048d37888"} Jul 06 18:20:59.864910 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.864831 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-j9cqz" Jul 06 18:20:59.894377 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:20:59.894311 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-j9cqz" podStartSLOduration=4.263332265 podStartE2EDuration="23.894287806s" totalImagesPullingTime="19.630955541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:59.873177651 +0000 UTC m=+93.951253588" watchObservedRunningTime="2026-07-06 18:20:59.894287806 +0000 UTC m=+93.972363742" Jul 06 18:21:00.869934 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:00.869852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pw2zb" event={"ID":"5aa39338-8d5d-48df-be18-44d4652d8485","Type":"ContainerStarted","Data":"42f74756283b1883b4e3f219c26639b2f19c72e9f935a11dc77c1c65373fdbed"} Jul 06 18:21:00.869934 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:00.869920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pw2zb" event={"ID":"5aa39338-8d5d-48df-be18-44d4652d8485","Type":"ContainerStarted","Data":"0b5f6ec8c88a6ab56c331fa74e97851c06a32b9844ad7a5e1918017661085e9f"} Jul 06 18:21:00.891118 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:00.891052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pw2zb" podStartSLOduration=1.844788659 podStartE2EDuration="9.891028848s" totalImagesPullingTime="7.961554373s" totalInitContainerRuntime="84.685816ms" isStatefulPod=true podCreationTimestamp="2026-07-06 18:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:21:00.88959007 +0000 UTC m=+94.967666053" watchObservedRunningTime="2026-07-06 18:21:00.891028848 +0000 UTC m=+94.969104786" Jul 06 18:21:01.876662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:01.876629 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2" exitCode=0 Jul 06 18:21:01.877124 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:01.876720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2"} Jul 06 18:21:01.879661 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:01.879624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" event={"ID":"3c9616ca-34cb-445d-8d68-95beec66ec51","Type":"ContainerStarted","Data":"f64e0b29c0f918743a9b65c5a7d8ac5e160b546c7dfab388758b40163a6b57d9"} Jul 06 18:21:02.890613 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:02.890551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" event={"ID":"3c9616ca-34cb-445d-8d68-95beec66ec51","Type":"ContainerStarted","Data":"8f94c1990c5931e105a8774b3b838ee9cd513a43e2d3faf2c588909e8ee4c63d"} Jul 06 18:21:02.891073 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:02.890656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" event={"ID":"3c9616ca-34cb-445d-8d68-95beec66ec51","Type":"ContainerStarted","Data":"c349865cf231de1af80985d6331b993e470ecfd24715a42cf3c0e4f8743c8fbe"} Jul 06 18:21:02.926285 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:02.926220 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84fdd57889-k8wdr" podStartSLOduration=4.16155214 podStartE2EDuration="6.926198683s" totalImagesPullingTime="2.764646543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:21:02.923089447 +0000 UTC m=+97.001165423" watchObservedRunningTime="2026-07-06 18:21:02.926198683 +0000 UTC m=+97.004274621" Jul 06 18:21:05.727824 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:05.727706 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cs5mt" Jul 06 18:21:06.912775 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:06.912731 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d"} Jul 06 18:21:07.921720 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:07.921678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234"} Jul 06 18:21:10.937203 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:10.937163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0"} Jul 06 18:21:10.937669 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:10.937261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600"} Jul 06 18:21:10.937669 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:10.937289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132"} Jul 06 18:21:10.937669 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:10.937326 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerStarted","Data":"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e"} Jul 06 18:21:10.970965 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:10.970910 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.910429696 podStartE2EDuration="13.970893147s" totalImagesPullingTime="10.038842611s" totalInitContainerRuntime="21.62084ms" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:21:10.96913316 +0000 UTC m=+105.047209096" watchObservedRunningTime="2026-07-06 18:21:10.970893147 +0000 UTC m=+105.048969083" Jul 06 18:21:12.581681 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:12.581642 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:21:23.203584 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.203539 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-988b5849-rbkdc" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerName="registry" containerID="cri-o://fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7" gracePeriod=30 Jul 06 18:21:23.480364 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.480292 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:21:23.624351 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624315 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624351 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624354 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt4j6\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624392 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624418 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624439 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624479 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624513 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.624607 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.624540 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration\") pod \"026a8fc3-5789-469e-8f53-cc9955beb6f7\" (UID: \"026a8fc3-5789-469e-8f53-cc9955beb6f7\") " Jul 06 18:21:23.625050 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.625011 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:21:23.625364 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.625316 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:21:23.627180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.627077 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:23.627180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.627117 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:23.627343 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.627172 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:21:23.627343 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.627290 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6" (OuterVolumeSpecName: "kube-api-access-bt4j6") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "kube-api-access-bt4j6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:23.627452 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.627424 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:21:23.633111 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.633084 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "026a8fc3-5789-469e-8f53-cc9955beb6f7" (UID: "026a8fc3-5789-469e-8f53-cc9955beb6f7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:23.725265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725229 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725258 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-trusted-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725268 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-image-registry-private-configuration\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725278 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/026a8fc3-5789-469e-8f53-cc9955beb6f7-installation-pull-secrets\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725288 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt4j6\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-kube-api-access-bt4j6\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725566 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725296 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/026a8fc3-5789-469e-8f53-cc9955beb6f7-ca-trust-extracted\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725566 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725307 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/026a8fc3-5789-469e-8f53-cc9955beb6f7-bound-sa-token\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.725566 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.725320 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/026a8fc3-5789-469e-8f53-cc9955beb6f7-registry-certificates\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:21:23.989004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.988967 2574 generic.go:356] "Generic (PLEG): container finished" podID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerID="fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7" exitCode=0 Jul 06 18:21:23.989169 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.989017 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988b5849-rbkdc" Jul 06 18:21:23.989169 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.989051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988b5849-rbkdc" event={"ID":"026a8fc3-5789-469e-8f53-cc9955beb6f7","Type":"ContainerDied","Data":"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7"} Jul 06 18:21:23.989169 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.989106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988b5849-rbkdc" event={"ID":"026a8fc3-5789-469e-8f53-cc9955beb6f7","Type":"ContainerDied","Data":"de1c86be854c4e308a95eb4c9b4ffc301b0c1347a6da3f8cc7178a739745e50e"} Jul 06 18:21:23.989169 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.989126 2574 scope.go:117] "RemoveContainer" containerID="fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7" Jul 06 18:21:23.997568 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.997551 2574 scope.go:117] "RemoveContainer" containerID="fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7" Jul 06 18:21:23.997868 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:21:23.997847 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7\": container with ID starting with fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7 not found: ID does not exist" containerID="fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7" Jul 06 18:21:23.997951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:23.997880 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7"} err="failed to get container status \"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7\": rpc error: code = NotFound desc = could not find container \"fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7\": container with ID starting with fa9baacaf60e7cea470cf8815a37e337cfa9c0fa9f4ec011e471f6cd14d58cc7 not found: ID does not exist" Jul 06 18:21:24.009920 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:24.009893 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:21:24.013158 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:24.013135 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-988b5849-rbkdc"] Jul 06 18:21:24.994095 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:24.994062 2574 generic.go:356] "Generic (PLEG): container finished" podID="529ec593-61d5-4c6c-9ba4-b87d3d0e7e56" containerID="d62f3c5dd9befa308619cd88eebe54579ba228a3f912210188a32c8afb564f81" exitCode=0 Jul 06 18:21:24.994543 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:24.994136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" event={"ID":"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56","Type":"ContainerDied","Data":"d62f3c5dd9befa308619cd88eebe54579ba228a3f912210188a32c8afb564f81"} Jul 06 18:21:24.994543 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:24.994516 2574 scope.go:117] "RemoveContainer" containerID="d62f3c5dd9befa308619cd88eebe54579ba228a3f912210188a32c8afb564f81" Jul 06 18:21:25.312102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:25.312020 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" path="/var/lib/kubelet/pods/026a8fc3-5789-469e-8f53-cc9955beb6f7/volumes" Jul 06 18:21:26.002953 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:26.002919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8565" event={"ID":"529ec593-61d5-4c6c-9ba4-b87d3d0e7e56","Type":"ContainerStarted","Data":"f27173d63c10ad3a46a5438a70ef88e9303b02d0e986b943edb097ce75ef34b6"} Jul 06 18:21:39.053741 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:39.053705 2574 generic.go:356] "Generic (PLEG): container finished" podID="e504b025-c2f2-4e9f-83d6-cc17e9f67a3e" containerID="f7c98959743c380183b7e6a953f60caeebd3465f03cb9ce80d6cdf2120e06723" exitCode=0 Jul 06 18:21:39.054243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:39.053755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" event={"ID":"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e","Type":"ContainerDied","Data":"f7c98959743c380183b7e6a953f60caeebd3465f03cb9ce80d6cdf2120e06723"} Jul 06 18:21:39.054243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:39.054127 2574 scope.go:117] "RemoveContainer" containerID="f7c98959743c380183b7e6a953f60caeebd3465f03cb9ce80d6cdf2120e06723" Jul 06 18:21:40.059849 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:40.059811 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-cjms7" event={"ID":"e504b025-c2f2-4e9f-83d6-cc17e9f67a3e","Type":"ContainerStarted","Data":"db9d8ed4676320903d0963a8bd32e11ac87cfa4db2ac3074c928e7252f7ce3ce"} Jul 06 18:21:45.078881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:45.078842 2574 generic.go:356] "Generic (PLEG): container finished" podID="42c61b44-fb83-4c62-be09-5aa4f451601f" containerID="5fd68ab95c35ea249c733c738175f5e100d3ba728ae1120d24b8c80324729074" exitCode=0 Jul 06 18:21:45.079417 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:45.078920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" event={"ID":"42c61b44-fb83-4c62-be09-5aa4f451601f","Type":"ContainerDied","Data":"5fd68ab95c35ea249c733c738175f5e100d3ba728ae1120d24b8c80324729074"} Jul 06 18:21:45.079417 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:45.079308 2574 scope.go:117] "RemoveContainer" containerID="5fd68ab95c35ea249c733c738175f5e100d3ba728ae1120d24b8c80324729074" Jul 06 18:21:46.085293 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:46.085257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mtzs6" event={"ID":"42c61b44-fb83-4c62-be09-5aa4f451601f","Type":"ContainerStarted","Data":"362a1831d2da85d4bff843a78a694a99665fdc9d4bb3a61120bf70b820ab38d8"} Jul 06 18:21:57.581936 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:57.581877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:21:57.597923 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:57.597898 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:21:58.160242 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:21:58.160216 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:15.628897 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.628860 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629141 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="prometheus" containerID="cri-o://c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d" gracePeriod=600 Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629177 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy" containerID="cri-o://2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600" gracePeriod=600 Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629198 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0" gracePeriod=600 Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629238 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="thanos-sidecar" containerID="cri-o://469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e" gracePeriod=600 Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629206 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-web" containerID="cri-o://646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132" gracePeriod=600 Jul 06 18:22:15.629433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:15.629224 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="config-reloader" containerID="cri-o://6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234" gracePeriod=600 Jul 06 18:22:16.222523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222491 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0" exitCode=0 Jul 06 18:22:16.222523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222514 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600" exitCode=0 Jul 06 18:22:16.222523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222520 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e" exitCode=0 Jul 06 18:22:16.222523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222526 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234" exitCode=0 Jul 06 18:22:16.222523 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222531 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d" exitCode=0 Jul 06 18:22:16.222870 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0"} Jul 06 18:22:16.222870 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600"} Jul 06 18:22:16.222870 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e"} Jul 06 18:22:16.222870 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234"} Jul 06 18:22:16.222870 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.222695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d"} Jul 06 18:22:16.868579 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.868554 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:16.996675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996583 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.996675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996652 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.996675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996675 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997003 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996737 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997003 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996762 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997003 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996813 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997003 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.996840 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997000 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997040 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997078 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997115 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997140 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997169 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997199 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997196 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.997521 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997202 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:16.997521 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.997225 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:16.999591 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:16.999558 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.000101 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000062 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.000265 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000080 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.000532 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000508 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.000750 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000576 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.000750 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000629 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.000750 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000517 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000756 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out" (OuterVolumeSpecName: "config-out") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000768 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000837 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv4bz\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000850 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000865 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000901 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets\") pod \"a6849477-268b-4275-9298-69cefbd09147\" (UID: \"a6849477-268b-4275-9298-69cefbd09147\") " Jul 06 18:22:17.000951 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.000938 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001163 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-kube-rbac-proxy\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001181 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001198 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001212 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001226 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001240 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001254 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001269 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001268 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001282 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-config-out\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001296 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.001660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001263 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.001829 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.001654 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:22:17.002904 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.002671 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.003010 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.002969 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.003440 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.003412 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.003540 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.003442 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.003661 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.003626 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:22:17.003740 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.003661 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config" (OuterVolumeSpecName: "config") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.003901 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.003884 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz" (OuterVolumeSpecName: "kube-api-access-kv4bz") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "kube-api-access-kv4bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:22:17.013292 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.013263 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config" (OuterVolumeSpecName: "web-config") pod "a6849477-268b-4275-9298-69cefbd09147" (UID: "a6849477-268b-4275-9298-69cefbd09147"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.102283 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102245 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-metrics-client-certs\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102283 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102274 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102283 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102285 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102298 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6849477-268b-4275-9298-69cefbd09147-prometheus-k8s-db\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102306 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-secret-grpc-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102314 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6849477-268b-4275-9298-69cefbd09147-configmap-metrics-client-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102322 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv4bz\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-kube-api-access-kv4bz\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102331 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102342 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6849477-268b-4275-9298-69cefbd09147-tls-assets\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.102558 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.102355 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6849477-268b-4275-9298-69cefbd09147-web-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.229692 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.229657 2574 generic.go:356] "Generic (PLEG): container finished" podID="a6849477-268b-4275-9298-69cefbd09147" containerID="646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132" exitCode=0 Jul 06 18:22:17.229877 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.229734 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.229877 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.229732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132"} Jul 06 18:22:17.229877 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.229841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6849477-268b-4275-9298-69cefbd09147","Type":"ContainerDied","Data":"bfc6597089084afb4afbb4e5247ca305915635dbea96501fc56ff11742162710"} Jul 06 18:22:17.229877 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.229877 2574 scope.go:117] "RemoveContainer" containerID="6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0" Jul 06 18:22:17.238189 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.238166 2574 scope.go:117] "RemoveContainer" containerID="2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600" Jul 06 18:22:17.248672 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.248658 2574 scope.go:117] "RemoveContainer" containerID="646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132" Jul 06 18:22:17.255664 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.255639 2574 scope.go:117] "RemoveContainer" containerID="469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e" Jul 06 18:22:17.256921 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.256902 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:17.263832 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.263815 2574 scope.go:117] "RemoveContainer" containerID="6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234" Jul 06 18:22:17.263899 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.263880 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:17.271396 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.271370 2574 scope.go:117] "RemoveContainer" containerID="c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d" Jul 06 18:22:17.279698 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.279678 2574 scope.go:117] "RemoveContainer" containerID="c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2" Jul 06 18:22:17.286680 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.286663 2574 scope.go:117] "RemoveContainer" containerID="6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0" Jul 06 18:22:17.286952 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.286931 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0\": container with ID starting with 6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0 not found: ID does not exist" containerID="6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0" Jul 06 18:22:17.287004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.286961 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0"} err="failed to get container status \"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0\": rpc error: code = NotFound desc = could not find container \"6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0\": container with ID starting with 6a983dbf1cd64b36fa5660f331e418bbbc1a9d8d1af4a2ac8adf5ed801b42de0 not found: ID does not exist" Jul 06 18:22:17.287004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.286980 2574 scope.go:117] "RemoveContainer" containerID="2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600" Jul 06 18:22:17.287239 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.287220 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600\": container with ID starting with 2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600 not found: ID does not exist" containerID="2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600" Jul 06 18:22:17.287291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287244 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600"} err="failed to get container status \"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600\": rpc error: code = NotFound desc = could not find container \"2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600\": container with ID starting with 2d07031823cd52acd3fcca572f3afe83a0d785b0bcfb70b7efe49b9e64481600 not found: ID does not exist" Jul 06 18:22:17.287291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287259 2574 scope.go:117] "RemoveContainer" containerID="646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132" Jul 06 18:22:17.287503 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.287489 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132\": container with ID starting with 646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132 not found: ID does not exist" containerID="646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132" Jul 06 18:22:17.287550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287505 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132"} err="failed to get container status \"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132\": rpc error: code = NotFound desc = could not find container \"646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132\": container with ID starting with 646aa2e80ddeb4869c799dd8654fc9135a46acd6485aceacdac6fcdd79535132 not found: ID does not exist" Jul 06 18:22:17.287550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287517 2574 scope.go:117] "RemoveContainer" containerID="469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e" Jul 06 18:22:17.287717 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.287700 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e\": container with ID starting with 469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e not found: ID does not exist" containerID="469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e" Jul 06 18:22:17.287758 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287721 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e"} err="failed to get container status \"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e\": rpc error: code = NotFound desc = could not find container \"469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e\": container with ID starting with 469ae3c1c82d057d82925dee577ec6359e54bcead769cbd2551274e20c55174e not found: ID does not exist" Jul 06 18:22:17.287758 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287733 2574 scope.go:117] "RemoveContainer" containerID="6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234" Jul 06 18:22:17.287986 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.287968 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234\": container with ID starting with 6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234 not found: ID does not exist" containerID="6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234" Jul 06 18:22:17.288026 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.287990 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234"} err="failed to get container status \"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234\": rpc error: code = NotFound desc = could not find container \"6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234\": container with ID starting with 6dfcfe366430f6fa3606286b2eef7d0bff49bfe1c31ce2f7a549c0b803b95234 not found: ID does not exist" Jul 06 18:22:17.288026 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.288004 2574 scope.go:117] "RemoveContainer" containerID="c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d" Jul 06 18:22:17.288250 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.288233 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d\": container with ID starting with c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d not found: ID does not exist" containerID="c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d" Jul 06 18:22:17.288291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.288260 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d"} err="failed to get container status \"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d\": rpc error: code = NotFound desc = could not find container \"c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d\": container with ID starting with c22cc9ff3ee632f24a95fb6112e9fa094a9d58c1a2f42e915637925ce2fc0b3d not found: ID does not exist" Jul 06 18:22:17.288291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.288276 2574 scope.go:117] "RemoveContainer" containerID="c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2" Jul 06 18:22:17.288468 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:22:17.288454 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2\": container with ID starting with c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2 not found: ID does not exist" containerID="c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2" Jul 06 18:22:17.288506 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.288472 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2"} err="failed to get container status \"c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2\": rpc error: code = NotFound desc = could not find container \"c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2\": container with ID starting with c6285b6945051f95be34f7b266f8e39146dbc08c3eff00fe7368ee331a5c0ef2 not found: ID does not exist" Jul 06 18:22:17.292094 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292072 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:17.292386 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292372 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-web" Jul 06 18:22:17.292431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292389 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-web" Jul 06 18:22:17.292431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292409 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerName="registry" Jul 06 18:22:17.292431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292415 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerName="registry" Jul 06 18:22:17.292431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292423 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="config-reloader" Jul 06 18:22:17.292431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292428 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="config-reloader" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292435 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="thanos-sidecar" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292441 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="thanos-sidecar" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292447 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-thanos" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292452 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-thanos" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292459 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292464 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292473 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="prometheus" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292478 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="prometheus" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292485 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="init-config-reloader" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292490 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="init-config-reloader" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292537 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292544 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="config-reloader" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292549 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="thanos-sidecar" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292555 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="026a8fc3-5789-469e-8f53-cc9955beb6f7" containerName="registry" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292562 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="prometheus" Jul 06 18:22:17.292567 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292569 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-web" Jul 06 18:22:17.293064 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.292576 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6849477-268b-4275-9298-69cefbd09147" containerName="kube-rbac-proxy-thanos" Jul 06 18:22:17.297434 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.297416 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.301414 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.301398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 18:22:17.301591 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.301577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 18:22:17.302158 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302093 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302156 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zq2dn\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-96nrucr1icfhp\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302229 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302243 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 18:22:17.302628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302419 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 18:22:17.303025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302648 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 18:22:17.303025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302677 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 18:22:17.303025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 18:22:17.303025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.302682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 18:22:17.303025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.303012 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 18:22:17.306209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.306189 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 18:22:17.309988 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.309970 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 18:22:17.311172 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.311150 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6849477-268b-4275-9298-69cefbd09147" path="/var/lib/kubelet/pods/a6849477-268b-4275-9298-69cefbd09147/volumes" Jul 06 18:22:17.316046 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.316026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:17.405308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnrp\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-kube-api-access-zjnrp\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.405767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.406068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.405775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.506717 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.506717 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507038 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507038 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507038 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507038 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507038 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.506978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnrp\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-kube-api-access-zjnrp\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.507606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.508057 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.507625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.508295 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.508271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.508405 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.508386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.508898 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.508872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.509612 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.509936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.510209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.510273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.510358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.510387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.510588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.510495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48655ee-aaf1-43ac-89ea-06c99497b1c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.511390 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.511364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.511713 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.511691 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.511882 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.511864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.512412 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.512394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.512624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.512608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.513183 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.513160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48655ee-aaf1-43ac-89ea-06c99497b1c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.513406 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.513383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48655ee-aaf1-43ac-89ea-06c99497b1c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.518195 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.518178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnrp\" (UniqueName: \"kubernetes.io/projected/b48655ee-aaf1-43ac-89ea-06c99497b1c2-kube-api-access-zjnrp\") pod \"prometheus-k8s-0\" (UID: \"b48655ee-aaf1-43ac-89ea-06c99497b1c2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.607259 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.607183 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:22:17.752481 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:17.752433 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 18:22:17.757751 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:22:17.757685 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48655ee_aaf1_43ac_89ea_06c99497b1c2.slice/crio-ae8f58c06de68dec766669a1fd7b2954d313281faef7ea99b82be5bcbff3f700 WatchSource:0}: Error finding container ae8f58c06de68dec766669a1fd7b2954d313281faef7ea99b82be5bcbff3f700: Status 404 returned error can't find the container with id ae8f58c06de68dec766669a1fd7b2954d313281faef7ea99b82be5bcbff3f700 Jul 06 18:22:18.234802 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:18.234747 2574 generic.go:356] "Generic (PLEG): container finished" podID="b48655ee-aaf1-43ac-89ea-06c99497b1c2" containerID="232b1ebba3c6ff38c4413997c88e4021f9334b32824d7310fad8efad1b09b442" exitCode=0 Jul 06 18:22:18.235246 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:18.234830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerDied","Data":"232b1ebba3c6ff38c4413997c88e4021f9334b32824d7310fad8efad1b09b442"} Jul 06 18:22:18.235246 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:18.234909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"ae8f58c06de68dec766669a1fd7b2954d313281faef7ea99b82be5bcbff3f700"} Jul 06 18:22:19.243967 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.243931 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"f2252b0058d16dabf7c701878ef9813392f35897461025a4a507797d3bbb21c2"} Jul 06 18:22:19.244447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.244002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"6a3781199785984923a414ec4b95344934e0967bc1253c8336c513aa505fe23d"} Jul 06 18:22:19.244447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.244042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"0c20f94787b4e730e0569ad6971e9e7ff9aaab58e0c6aabf1d0dd7f7012d3f40"} Jul 06 18:22:19.244447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.244104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"9f032b03bea964cd78c467cebd8d12e66588662b631e5e2348d37024345365aa"} Jul 06 18:22:19.244447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.244150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"bf399c6422deefd303387ac24cd1934537ffbfa6b3c5ee98f473791099642fe7"} Jul 06 18:22:19.244447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.244197 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48655ee-aaf1-43ac-89ea-06c99497b1c2","Type":"ContainerStarted","Data":"ea4e16c73f54d92f0ca5beaa2845785324654c48cd00d90db5aa12de1ab098cd"} Jul 06 18:22:19.273332 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:19.273272 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.2507015040000002 podStartE2EDuration="2.273252807s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.551303ms" isStatefulPod=false podCreationTimestamp="2026-07-06 18:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:22:19.27051746 +0000 UTC m=+173.348593396" watchObservedRunningTime="2026-07-06 18:22:19.273252807 +0000 UTC m=+173.351328743" Jul 06 18:22:22.607913 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:22:22.607868 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:23:17.607739 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:23:17.607694 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:23:17.623730 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:23:17.623706 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:23:18.489011 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:23:18.488975 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 18:24:21.232305 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.232260 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4"] Jul 06 18:24:21.235738 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.235716 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.238662 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.238554 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 18:24:21.238819 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.238719 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 18:24:21.238907 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.238887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 18:24:21.238974 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.238916 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 18:24:21.239032 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.238998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mm5zn\"" Jul 06 18:24:21.249966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.249934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4"] Jul 06 18:24:21.264702 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.264670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-tmp\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.264881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.264707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.264881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.264740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pg58\" (UniqueName: \"kubernetes.io/projected/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-kube-api-access-9pg58\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.264881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.264842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-manifests\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.264881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.264864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-manifests\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-tmp\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365687 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pg58\" (UniqueName: \"kubernetes.io/projected/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-kube-api-access-9pg58\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.365948 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.365921 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-manifests\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.367927 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.367902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-tmp\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.368140 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.368125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.368183 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.368159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.374108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.374085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pg58\" (UniqueName: \"kubernetes.io/projected/a34fd8b1-56e1-4264-99ad-ad6a4a94022e-kube-api-access-9pg58\") pod \"opendatahub-operator-controller-manager-bf95b557-bhfr4\" (UID: \"a34fd8b1-56e1-4264-99ad-ad6a4a94022e\") " pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.545639 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.545543 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:21.686632 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.686604 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4"] Jul 06 18:24:21.689521 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:24:21.689497 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34fd8b1_56e1_4264_99ad_ad6a4a94022e.slice/crio-9ef99183ca8edaa0fdac46af611bbb7c33677755168e0ebf3d265c80fd9967c3 WatchSource:0}: Error finding container 9ef99183ca8edaa0fdac46af611bbb7c33677755168e0ebf3d265c80fd9967c3: Status 404 returned error can't find the container with id 9ef99183ca8edaa0fdac46af611bbb7c33677755168e0ebf3d265c80fd9967c3 Jul 06 18:24:21.729436 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:21.729401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" event={"ID":"a34fd8b1-56e1-4264-99ad-ad6a4a94022e","Type":"ContainerStarted","Data":"9ef99183ca8edaa0fdac46af611bbb7c33677755168e0ebf3d265c80fd9967c3"} Jul 06 18:24:24.745756 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:24.745654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" event={"ID":"a34fd8b1-56e1-4264-99ad-ad6a4a94022e","Type":"ContainerStarted","Data":"c819c3ca01d3a2a267e548df4f89e983990eb3d33ba6471cebc4b96d691c928e"} Jul 06 18:24:25.751931 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:25.751896 2574 generic.go:356] "Generic (PLEG): container finished" podID="a34fd8b1-56e1-4264-99ad-ad6a4a94022e" containerID="c819c3ca01d3a2a267e548df4f89e983990eb3d33ba6471cebc4b96d691c928e" exitCode=0 Jul 06 18:24:25.752343 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:25.751979 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" event={"ID":"a34fd8b1-56e1-4264-99ad-ad6a4a94022e","Type":"ContainerDied","Data":"c819c3ca01d3a2a267e548df4f89e983990eb3d33ba6471cebc4b96d691c928e"} Jul 06 18:24:26.758874 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:26.758837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" event={"ID":"a34fd8b1-56e1-4264-99ad-ad6a4a94022e","Type":"ContainerStarted","Data":"035db47011a868e69777a595587d3b08a64bd96f197580b375d8c08b01e6e405"} Jul 06 18:24:26.759278 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:26.758970 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:26.784035 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:26.783972 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" podStartSLOduration=1.527021059 podStartE2EDuration="5.78395583s" totalImagesPullingTime="3.184255617s" totalInitContainerRuntime="1.072679154s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:26.781626503 +0000 UTC m=+300.859702465" watchObservedRunningTime="2026-07-06 18:24:26.78395583 +0000 UTC m=+300.862031767" Jul 06 18:24:27.173745 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:27.173719 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:24:27.179445 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:27.179419 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:24:27.185703 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:27.185677 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 18:24:37.766086 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:37.766056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bf95b557-bhfr4" Jul 06 18:24:40.234172 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.234129 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v"] Jul 06 18:24:40.236364 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.236348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.239089 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.239067 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 18:24:40.240417 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.240398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 18:24:40.240760 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.240734 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wkwhz\"" Jul 06 18:24:40.240893 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.240744 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 18:24:40.240893 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.240817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 18:24:40.240893 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.240803 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 18:24:40.246425 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.246402 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v"] Jul 06 18:24:40.332437 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.332363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-metrics-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.332623 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.332469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2e0204f-b3fc-484e-adaf-a56727ec0d84-manager-config\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.332623 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.332492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbnbt\" (UniqueName: \"kubernetes.io/projected/c2e0204f-b3fc-484e-adaf-a56727ec0d84-kube-api-access-zbnbt\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.332623 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.332528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.434062 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.434025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.434275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.434111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-metrics-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.434609 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.434567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2e0204f-b3fc-484e-adaf-a56727ec0d84-manager-config\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.434727 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.434662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbnbt\" (UniqueName: \"kubernetes.io/projected/c2e0204f-b3fc-484e-adaf-a56727ec0d84-kube-api-access-zbnbt\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.435335 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.435312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2e0204f-b3fc-484e-adaf-a56727ec0d84-manager-config\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.437007 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.436992 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-metrics-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.437067 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.437038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e0204f-b3fc-484e-adaf-a56727ec0d84-cert\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.451838 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.451808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbnbt\" (UniqueName: \"kubernetes.io/projected/c2e0204f-b3fc-484e-adaf-a56727ec0d84-kube-api-access-zbnbt\") pod \"lws-controller-manager-77945c4cd8-8kh5v\" (UID: \"c2e0204f-b3fc-484e-adaf-a56727ec0d84\") " pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.546735 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.546633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:40.684078 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.683856 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v"] Jul 06 18:24:40.686778 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:24:40.686751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e0204f_b3fc_484e_adaf_a56727ec0d84.slice/crio-2cf7302c2771bb7808aefb609a2e19c4e775c4eb400d6d1e5a7b8ff6b58ed494 WatchSource:0}: Error finding container 2cf7302c2771bb7808aefb609a2e19c4e775c4eb400d6d1e5a7b8ff6b58ed494: Status 404 returned error can't find the container with id 2cf7302c2771bb7808aefb609a2e19c4e775c4eb400d6d1e5a7b8ff6b58ed494 Jul 06 18:24:40.688608 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.688592 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:24:40.819045 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:40.818955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" event={"ID":"c2e0204f-b3fc-484e-adaf-a56727ec0d84","Type":"ContainerStarted","Data":"2cf7302c2771bb7808aefb609a2e19c4e775c4eb400d6d1e5a7b8ff6b58ed494"} Jul 06 18:24:43.835034 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:43.834997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" event={"ID":"c2e0204f-b3fc-484e-adaf-a56727ec0d84","Type":"ContainerStarted","Data":"e79a13c52cc29b2eb199561175b0c51c38d821babc2675a73bda370fca0cc48c"} Jul 06 18:24:43.835460 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:43.835079 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:43.852246 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:43.852174 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" podStartSLOduration=1.512192977 podStartE2EDuration="3.852158047s" totalImagesPullingTime="2.33996507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:43.850083928 +0000 UTC m=+317.928159868" watchObservedRunningTime="2026-07-06 18:24:43.852158047 +0000 UTC m=+317.930233982" Jul 06 18:24:51.994190 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:51.994152 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-88568c598-lw9qn"] Jul 06 18:24:51.997714 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:51.997691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.003657 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.003450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 18:24:52.004542 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.004429 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 18:24:52.004542 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.004429 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gnplr\"" Jul 06 18:24:52.016326 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.016291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-88568c598-lw9qn"] Jul 06 18:24:52.139817 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.139756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cadbbd5a-c465-4e24-8911-beb3e216cdff-tmp\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.140004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.139876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cadbbd5a-c465-4e24-8911-beb3e216cdff-tls-certs\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.140004 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.139944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrmr\" (UniqueName: \"kubernetes.io/projected/cadbbd5a-c465-4e24-8911-beb3e216cdff-kube-api-access-dsrmr\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.241821 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.241202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cadbbd5a-c465-4e24-8911-beb3e216cdff-tls-certs\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.241821 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.241305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrmr\" (UniqueName: \"kubernetes.io/projected/cadbbd5a-c465-4e24-8911-beb3e216cdff-kube-api-access-dsrmr\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.241821 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.241376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cadbbd5a-c465-4e24-8911-beb3e216cdff-tmp\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.248180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.248103 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cadbbd5a-c465-4e24-8911-beb3e216cdff-tmp\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.248529 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.248510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cadbbd5a-c465-4e24-8911-beb3e216cdff-tls-certs\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.259268 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.259242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrmr\" (UniqueName: \"kubernetes.io/projected/cadbbd5a-c465-4e24-8911-beb3e216cdff-kube-api-access-dsrmr\") pod \"kube-auth-proxy-88568c598-lw9qn\" (UID: \"cadbbd5a-c465-4e24-8911-beb3e216cdff\") " pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.308948 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.308914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" Jul 06 18:24:52.452491 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.452465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-88568c598-lw9qn"] Jul 06 18:24:52.455019 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:24:52.454991 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadbbd5a_c465_4e24_8911_beb3e216cdff.slice/crio-77cf2e6bfeaf26dac6cdb5b52ee8a32dc46ae4c43dcc48bf920c88f56ed879eb WatchSource:0}: Error finding container 77cf2e6bfeaf26dac6cdb5b52ee8a32dc46ae4c43dcc48bf920c88f56ed879eb: Status 404 returned error can't find the container with id 77cf2e6bfeaf26dac6cdb5b52ee8a32dc46ae4c43dcc48bf920c88f56ed879eb Jul 06 18:24:52.872483 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:52.872449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" event={"ID":"cadbbd5a-c465-4e24-8911-beb3e216cdff","Type":"ContainerStarted","Data":"77cf2e6bfeaf26dac6cdb5b52ee8a32dc46ae4c43dcc48bf920c88f56ed879eb"} Jul 06 18:24:54.841457 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:54.841419 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77945c4cd8-8kh5v" Jul 06 18:24:55.888076 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:55.888038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" event={"ID":"cadbbd5a-c465-4e24-8911-beb3e216cdff","Type":"ContainerStarted","Data":"b4e5312b75e41373339fe95980e56ec7974af0fd4482da8c39b08cfc3e1d8e84"} Jul 06 18:24:55.908480 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:24:55.908426 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-88568c598-lw9qn" podStartSLOduration=2.036114093 podStartE2EDuration="4.908409365s" totalImagesPullingTime="2.872295272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:55.907456576 +0000 UTC m=+329.985532533" watchObservedRunningTime="2026-07-06 18:24:55.908409365 +0000 UTC m=+329.986485360" Jul 06 18:26:26.233675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.233632 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr"] Jul 06 18:26:26.237123 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.237098 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.239863 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.239837 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 18:26:26.240123 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.240099 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 18:26:26.240311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.240293 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 18:26:26.241178 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.241158 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 18:26:26.241277 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.241168 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jqz8q\"" Jul 06 18:26:26.244929 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.244715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr"] Jul 06 18:26:26.383121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.383077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.383121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.383134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmmn\" (UniqueName: \"kubernetes.io/projected/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-kube-api-access-hdmmn\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.383348 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.383245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.484309 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.484214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmmn\" (UniqueName: \"kubernetes.io/projected/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-kube-api-access-hdmmn\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.484309 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.484276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.484547 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.484345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.484547 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:26:26.484458 2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 18:26:26.484547 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:26:26.484525 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert podName:8a292301-d4bf-46ad-94a9-4f3739ee3d0c nodeName:}" failed. No retries permitted until 2026-07-06 18:26:26.984506438 +0000 UTC m=+421.062582352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pt8dr" (UID: "8a292301-d4bf-46ad-94a9-4f3739ee3d0c") : secret "plugin-serving-cert" not found Jul 06 18:26:26.485052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.485033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.492721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.492697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmmn\" (UniqueName: \"kubernetes.io/projected/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-kube-api-access-hdmmn\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.988940 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.988898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:26.991235 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:26.991211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a292301-d4bf-46ad-94a9-4f3739ee3d0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pt8dr\" (UID: \"8a292301-d4bf-46ad-94a9-4f3739ee3d0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:27.159151 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:27.159113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jqz8q\"" Jul 06 18:26:27.166541 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:27.166515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" Jul 06 18:26:27.305542 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:27.305484 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr"] Jul 06 18:26:27.310186 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:26:27.310153 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a292301_d4bf_46ad_94a9_4f3739ee3d0c.slice/crio-fa32405fec3ab51def8f5d877d333cff846dd31ae948c107c0d793bb37d97646 WatchSource:0}: Error finding container fa32405fec3ab51def8f5d877d333cff846dd31ae948c107c0d793bb37d97646: Status 404 returned error can't find the container with id fa32405fec3ab51def8f5d877d333cff846dd31ae948c107c0d793bb37d97646 Jul 06 18:26:28.282656 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:28.282608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" event={"ID":"8a292301-d4bf-46ad-94a9-4f3739ee3d0c","Type":"ContainerStarted","Data":"fa32405fec3ab51def8f5d877d333cff846dd31ae948c107c0d793bb37d97646"} Jul 06 18:26:36.760353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.760316 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj"] Jul 06 18:26:36.798270 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.798232 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj"] Jul 06 18:26:36.798459 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.798336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:36.805505 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.805459 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tdswx\"" Jul 06 18:26:36.878644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.878608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf6fr\" (UniqueName: \"kubernetes.io/projected/50dc14de-b06d-424a-a9fa-79a6963fd85c-kube-api-access-sf6fr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzmj\" (UID: \"50dc14de-b06d-424a-a9fa-79a6963fd85c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:36.979616 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.979575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf6fr\" (UniqueName: \"kubernetes.io/projected/50dc14de-b06d-424a-a9fa-79a6963fd85c-kube-api-access-sf6fr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzmj\" (UID: \"50dc14de-b06d-424a-a9fa-79a6963fd85c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:36.992954 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:36.992924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf6fr\" (UniqueName: \"kubernetes.io/projected/50dc14de-b06d-424a-a9fa-79a6963fd85c-kube-api-access-sf6fr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzmj\" (UID: \"50dc14de-b06d-424a-a9fa-79a6963fd85c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:37.111632 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:37.111546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:48.626817 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:48.626768 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj"] Jul 06 18:26:48.628303 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:26:48.628271 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50dc14de_b06d_424a_a9fa_79a6963fd85c.slice/crio-badb50c58558c54f8d98488fdc2307cc31aca1dc4cef82ee4b5de0773fe1fa39 WatchSource:0}: Error finding container badb50c58558c54f8d98488fdc2307cc31aca1dc4cef82ee4b5de0773fe1fa39: Status 404 returned error can't find the container with id badb50c58558c54f8d98488fdc2307cc31aca1dc4cef82ee4b5de0773fe1fa39 Jul 06 18:26:49.393554 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:49.393519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" event={"ID":"8a292301-d4bf-46ad-94a9-4f3739ee3d0c","Type":"ContainerStarted","Data":"080a8483f4a42557491b4ce5f34e2be46f1c9a0651326756e473d03282412ed6"} Jul 06 18:26:49.394719 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:49.394694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" event={"ID":"50dc14de-b06d-424a-a9fa-79a6963fd85c","Type":"ContainerStarted","Data":"badb50c58558c54f8d98488fdc2307cc31aca1dc4cef82ee4b5de0773fe1fa39"} Jul 06 18:26:49.412058 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:49.411998 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pt8dr" podStartSLOduration=2.161866031 podStartE2EDuration="23.411979336s" totalImagesPullingTime="21.250113305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:49.410815999 +0000 UTC m=+443.488891933" watchObservedRunningTime="2026-07-06 18:26:49.411979336 +0000 UTC m=+443.490055272" Jul 06 18:26:53.415213 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:53.415172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" event={"ID":"50dc14de-b06d-424a-a9fa-79a6963fd85c","Type":"ContainerStarted","Data":"747139d2afab73e4edee2082893085442282af69619dabcdb8be84b3a9bcbc6a"} Jul 06 18:26:53.415625 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:53.415306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:26:53.433971 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:26:53.433917 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" podStartSLOduration=13.439706739 podStartE2EDuration="17.433901432s" totalImagesPullingTime="3.994194693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:53.43301318 +0000 UTC m=+447.511089132" watchObservedRunningTime="2026-07-06 18:26:53.433901432 +0000 UTC m=+447.511977406" Jul 06 18:27:04.422071 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:04.422039 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzmj" Jul 06 18:27:14.313139 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.313097 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:27:14.322232 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.322190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:27:14.325314 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.325294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5bwhk\"" Jul 06 18:27:14.330225 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.330206 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:27:14.413077 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.413040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgfms\" (UniqueName: \"kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms\") pod \"authorino-75d556bd77-sb5ds\" (UID: \"2b4001bb-463f-494e-90c3-6bbba883fdc5\") " pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:27:14.514425 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.514389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgfms\" (UniqueName: \"kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms\") pod \"authorino-75d556bd77-sb5ds\" (UID: \"2b4001bb-463f-494e-90c3-6bbba883fdc5\") " pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:27:14.522985 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.522958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgfms\" (UniqueName: \"kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms\") pod \"authorino-75d556bd77-sb5ds\" (UID: \"2b4001bb-463f-494e-90c3-6bbba883fdc5\") " pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:27:14.632246 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.632151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:27:14.762007 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:14.761972 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:27:14.765554 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:27:14.765513 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b4001bb_463f_494e_90c3_6bbba883fdc5.slice/crio-b142550e723cbb6b74798bd61e41fd29232a1c86e91ac3180efb7ebadbb9a20a WatchSource:0}: Error finding container b142550e723cbb6b74798bd61e41fd29232a1c86e91ac3180efb7ebadbb9a20a: Status 404 returned error can't find the container with id b142550e723cbb6b74798bd61e41fd29232a1c86e91ac3180efb7ebadbb9a20a Jul 06 18:27:15.515721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:15.515680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sb5ds" event={"ID":"2b4001bb-463f-494e-90c3-6bbba883fdc5","Type":"ContainerStarted","Data":"b142550e723cbb6b74798bd61e41fd29232a1c86e91ac3180efb7ebadbb9a20a"} Jul 06 18:27:18.532575 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:18.532534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sb5ds" event={"ID":"2b4001bb-463f-494e-90c3-6bbba883fdc5","Type":"ContainerStarted","Data":"cf62b3c9d68cc1718663eded19353ea4405ee209332da7347be211dce58deb71"} Jul 06 18:27:18.548518 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:27:18.548453 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sb5ds" podStartSLOduration=1.4940972399999999 podStartE2EDuration="4.548431424s" totalImagesPullingTime="3.054334184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:27:18.546305575 +0000 UTC m=+472.624381510" watchObservedRunningTime="2026-07-06 18:27:18.548431424 +0000 UTC m=+472.626507361" Jul 06 18:28:17.765378 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.765342 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:28:17.768935 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.768915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:17.771982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.771952 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 06 18:28:17.772109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.771987 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 06 18:28:17.774130 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.774111 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5clg6\"" Jul 06 18:28:17.774252 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.774162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 06 18:28:17.778909 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.778885 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:28:17.864320 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.864282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfm78\" (UniqueName: \"kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78\") pod \"maas-keycloak-0\" (UID: \"38d6632f-47a5-459c-8b65-9d77089edbdb\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:17.965268 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.965185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfm78\" (UniqueName: \"kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78\") pod \"maas-keycloak-0\" (UID: \"38d6632f-47a5-459c-8b65-9d77089edbdb\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:17.974832 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:17.974804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfm78\" (UniqueName: \"kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78\") pod \"maas-keycloak-0\" (UID: \"38d6632f-47a5-459c-8b65-9d77089edbdb\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:18.078369 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:18.078277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:18.218555 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:18.218520 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:28:18.224160 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:28:18.221890 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d6632f_47a5_459c_8b65_9d77089edbdb.slice/crio-5328fd35eb741c7893c557938097b4a653aa7f93c20fc924cb22d23476a70a1e WatchSource:0}: Error finding container 5328fd35eb741c7893c557938097b4a653aa7f93c20fc924cb22d23476a70a1e: Status 404 returned error can't find the container with id 5328fd35eb741c7893c557938097b4a653aa7f93c20fc924cb22d23476a70a1e Jul 06 18:28:18.808187 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:18.808149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38d6632f-47a5-459c-8b65-9d77089edbdb","Type":"ContainerStarted","Data":"5328fd35eb741c7893c557938097b4a653aa7f93c20fc924cb22d23476a70a1e"} Jul 06 18:28:23.838308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:23.838262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38d6632f-47a5-459c-8b65-9d77089edbdb","Type":"ContainerStarted","Data":"5b2c898ba88e377927e598c59986b2e0bc05569ce754a7c22936e042ccd9e4e0"} Jul 06 18:28:23.858190 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:23.858118 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.744419744 podStartE2EDuration="6.858094828s" totalImagesPullingTime="5.113675084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:28:23.855638346 +0000 UTC m=+537.933714286" watchObservedRunningTime="2026-07-06 18:28:23.858094828 +0000 UTC m=+537.936170765" Jul 06 18:28:24.078676 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:24.078635 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:24.080476 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:24.080440 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:25.078922 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:25.078869 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:26.079316 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:26.079277 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:27.079694 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:27.079637 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:28.079780 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:28.079724 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:28.080906 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:28.080884 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:29.079385 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:29.079327 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:30.079700 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:30.079650 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:31.079308 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:31.079253 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:32.079730 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:32.079688 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:33.078998 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:33.078948 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:34.079592 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:34.079532 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:35.079522 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:35.079469 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:36.078719 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:36.078677 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Jul 06 18:28:37.197144 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:37.197090 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:37.214952 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:37.214708 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:28:47.203100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:47.203065 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 06 18:28:49.838325 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:49.838292 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:28:49.838776 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:49.838452 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sb5ds" podUID="2b4001bb-463f-494e-90c3-6bbba883fdc5" containerName="authorino" containerID="cri-o://cf62b3c9d68cc1718663eded19353ea4405ee209332da7347be211dce58deb71" gracePeriod=30 Jul 06 18:28:49.989246 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:49.989214 2574 generic.go:356] "Generic (PLEG): container finished" podID="2b4001bb-463f-494e-90c3-6bbba883fdc5" containerID="cf62b3c9d68cc1718663eded19353ea4405ee209332da7347be211dce58deb71" exitCode=0 Jul 06 18:28:49.989406 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:49.989270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sb5ds" event={"ID":"2b4001bb-463f-494e-90c3-6bbba883fdc5","Type":"ContainerDied","Data":"cf62b3c9d68cc1718663eded19353ea4405ee209332da7347be211dce58deb71"} Jul 06 18:28:50.090685 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.090623 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:28:50.181528 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.181483 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgfms\" (UniqueName: \"kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms\") pod \"2b4001bb-463f-494e-90c3-6bbba883fdc5\" (UID: \"2b4001bb-463f-494e-90c3-6bbba883fdc5\") " Jul 06 18:28:50.183553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.183520 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms" (OuterVolumeSpecName: "kube-api-access-bgfms") pod "2b4001bb-463f-494e-90c3-6bbba883fdc5" (UID: "2b4001bb-463f-494e-90c3-6bbba883fdc5"). InnerVolumeSpecName "kube-api-access-bgfms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:28:50.282608 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.282567 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgfms\" (UniqueName: \"kubernetes.io/projected/2b4001bb-463f-494e-90c3-6bbba883fdc5-kube-api-access-bgfms\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:28:50.994417 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.994387 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sb5ds" Jul 06 18:28:50.994417 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.994398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sb5ds" event={"ID":"2b4001bb-463f-494e-90c3-6bbba883fdc5","Type":"ContainerDied","Data":"b142550e723cbb6b74798bd61e41fd29232a1c86e91ac3180efb7ebadbb9a20a"} Jul 06 18:28:50.994977 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:50.994447 2574 scope.go:117] "RemoveContainer" containerID="cf62b3c9d68cc1718663eded19353ea4405ee209332da7347be211dce58deb71" Jul 06 18:28:51.016663 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:51.016601 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:28:51.018110 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:51.018085 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sb5ds"] Jul 06 18:28:51.311827 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:51.311727 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4001bb-463f-494e-90c3-6bbba883fdc5" path="/var/lib/kubelet/pods/2b4001bb-463f-494e-90c3-6bbba883fdc5/volumes" Jul 06 18:28:54.192871 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.192830 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:28:54.193334 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.193301 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4001bb-463f-494e-90c3-6bbba883fdc5" containerName="authorino" Jul 06 18:28:54.193334 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.193318 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4001bb-463f-494e-90c3-6bbba883fdc5" containerName="authorino" Jul 06 18:28:54.193443 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.193428 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4001bb-463f-494e-90c3-6bbba883fdc5" containerName="authorino" Jul 06 18:28:54.197559 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.197539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.201231 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.201210 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 18:28:54.201353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.201282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtfhd\"" Jul 06 18:28:54.201353 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.201323 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 18:28:54.208125 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.208102 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:28:54.321006 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.320957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.321191 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.321064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6p4z\" (UniqueName: \"kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.377041 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.377014 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:28:54.380272 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.380254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.391433 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.391410 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:28:54.422036 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.422000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.422233 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.422079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6p4z\" (UniqueName: \"kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.422233 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:28:54.422158 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 18:28:54.422233 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:28:54.422227 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert podName:16e982cb-608e-46ce-a590-855e927097dc nodeName:}" failed. No retries permitted until 2026-07-06 18:28:54.922207655 +0000 UTC m=+569.000283568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert") pod "maas-controller-6b4f64cb78-5j5s2" (UID: "16e982cb-608e-46ce-a590-855e927097dc") : secret "maas-controller-webhook-cert" not found Jul 06 18:28:54.431601 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.431569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6p4z\" (UniqueName: \"kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.522529 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.522438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmj74\" (UniqueName: \"kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.522529 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.522522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.623062 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.623021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmj74\" (UniqueName: \"kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.623264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.623112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.623264 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:28:54.623208 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 18:28:54.623264 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:28:54.623257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert podName:8817b486-017e-4ba8-b0ca-15ab8402d200 nodeName:}" failed. No retries permitted until 2026-07-06 18:28:55.12324268 +0000 UTC m=+569.201318596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert") pod "maas-controller-5cdf75475b-pbd27" (UID: "8817b486-017e-4ba8-b0ca-15ab8402d200") : secret "maas-controller-webhook-cert" not found Jul 06 18:28:54.632044 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.632012 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmj74\" (UniqueName: \"kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:54.925274 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.925229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:54.927636 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:54.927614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") pod \"maas-controller-6b4f64cb78-5j5s2\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:55.107415 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.107378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:55.126771 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.126744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:55.129118 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.129091 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") pod \"maas-controller-5cdf75475b-pbd27\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:55.236124 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.236101 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:28:55.238302 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:28:55.238278 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e982cb_608e_46ce_a590_855e927097dc.slice/crio-c817c33cb322847ba905dd3f685f863bd2967a0f3b705212cbe651cc544c1b94 WatchSource:0}: Error finding container c817c33cb322847ba905dd3f685f863bd2967a0f3b705212cbe651cc544c1b94: Status 404 returned error can't find the container with id c817c33cb322847ba905dd3f685f863bd2967a0f3b705212cbe651cc544c1b94 Jul 06 18:28:55.291755 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.291718 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:55.422776 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:55.422745 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:28:55.425722 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:28:55.425690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8817b486_017e_4ba8_b0ca_15ab8402d200.slice/crio-14038d033769e7760c2cd434e32113176c9af937d3694e3f98bc81e9fb7b0201 WatchSource:0}: Error finding container 14038d033769e7760c2cd434e32113176c9af937d3694e3f98bc81e9fb7b0201: Status 404 returned error can't find the container with id 14038d033769e7760c2cd434e32113176c9af937d3694e3f98bc81e9fb7b0201 Jul 06 18:28:56.022085 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:56.022008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-pbd27" event={"ID":"8817b486-017e-4ba8-b0ca-15ab8402d200","Type":"ContainerStarted","Data":"14038d033769e7760c2cd434e32113176c9af937d3694e3f98bc81e9fb7b0201"} Jul 06 18:28:56.024362 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:56.024026 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" event={"ID":"16e982cb-608e-46ce-a590-855e927097dc","Type":"ContainerStarted","Data":"c817c33cb322847ba905dd3f685f863bd2967a0f3b705212cbe651cc544c1b94"} Jul 06 18:28:58.035610 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.035554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" event={"ID":"16e982cb-608e-46ce-a590-855e927097dc","Type":"ContainerStarted","Data":"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc"} Jul 06 18:28:58.036081 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.035630 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:28:58.037142 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.037121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-pbd27" event={"ID":"8817b486-017e-4ba8-b0ca-15ab8402d200","Type":"ContainerStarted","Data":"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491"} Jul 06 18:28:58.037240 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.037205 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:28:58.058986 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.058926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" podStartSLOduration=1.423120372 podStartE2EDuration="4.058907912s" totalImagesPullingTime="2.63578754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:28:58.057261786 +0000 UTC m=+572.135337741" watchObservedRunningTime="2026-07-06 18:28:58.058907912 +0000 UTC m=+572.136983848" Jul 06 18:28:58.093187 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:28:58.093132 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdf75475b-pbd27" podStartSLOduration=1.63506796 podStartE2EDuration="4.093117242s" totalImagesPullingTime="2.458049282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:28:58.091615068 +0000 UTC m=+572.169691020" watchObservedRunningTime="2026-07-06 18:28:58.093117242 +0000 UTC m=+572.171193177" Jul 06 18:29:09.051475 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.051443 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:29:09.052087 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.051759 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:29:09.216249 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.216206 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:29:09.216420 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.216387 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" podUID="16e982cb-608e-46ce-a590-855e927097dc" containerName="manager" containerID="cri-o://53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc" gracePeriod=30 Jul 06 18:29:09.459834 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.459813 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:29:09.551430 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.551394 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") pod \"16e982cb-608e-46ce-a590-855e927097dc\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " Jul 06 18:29:09.551629 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.551496 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6p4z\" (UniqueName: \"kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z\") pod \"16e982cb-608e-46ce-a590-855e927097dc\" (UID: \"16e982cb-608e-46ce-a590-855e927097dc\") " Jul 06 18:29:09.553519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.553488 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "16e982cb-608e-46ce-a590-855e927097dc" (UID: "16e982cb-608e-46ce-a590-855e927097dc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:29:09.553624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.553559 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z" (OuterVolumeSpecName: "kube-api-access-k6p4z") pod "16e982cb-608e-46ce-a590-855e927097dc" (UID: "16e982cb-608e-46ce-a590-855e927097dc"). InnerVolumeSpecName "kube-api-access-k6p4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:29:09.652701 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.652671 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16e982cb-608e-46ce-a590-855e927097dc-webhook-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:29:09.652701 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:09.652699 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6p4z\" (UniqueName: \"kubernetes.io/projected/16e982cb-608e-46ce-a590-855e927097dc-kube-api-access-k6p4z\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:29:10.090239 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.090155 2574 generic.go:356] "Generic (PLEG): container finished" podID="16e982cb-608e-46ce-a590-855e927097dc" containerID="53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc" exitCode=0 Jul 06 18:29:10.090239 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.090200 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" Jul 06 18:29:10.090645 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.090202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" event={"ID":"16e982cb-608e-46ce-a590-855e927097dc","Type":"ContainerDied","Data":"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc"} Jul 06 18:29:10.090645 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.090329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b4f64cb78-5j5s2" event={"ID":"16e982cb-608e-46ce-a590-855e927097dc","Type":"ContainerDied","Data":"c817c33cb322847ba905dd3f685f863bd2967a0f3b705212cbe651cc544c1b94"} Jul 06 18:29:10.090645 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.090361 2574 scope.go:117] "RemoveContainer" containerID="53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc" Jul 06 18:29:10.098974 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.098958 2574 scope.go:117] "RemoveContainer" containerID="53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc" Jul 06 18:29:10.099230 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:29:10.099210 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc\": container with ID starting with 53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc not found: ID does not exist" containerID="53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc" Jul 06 18:29:10.099291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.099245 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc"} err="failed to get container status \"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc\": rpc error: code = NotFound desc = could not find container \"53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc\": container with ID starting with 53482257007e63cbae5cd57edfd5c700433de795edc97adfd11ab9986a3634bc not found: ID does not exist" Jul 06 18:29:10.118842 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.118812 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:29:10.128726 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:10.128698 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b4f64cb78-5j5s2"] Jul 06 18:29:11.312025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:11.311994 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e982cb-608e-46ce-a590-855e927097dc" path="/var/lib/kubelet/pods/16e982cb-608e-46ce-a590-855e927097dc/volumes" Jul 06 18:29:27.203802 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:27.203755 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:29:27.213296 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:27.213267 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:29:29.198983 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.198948 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7d886d7d97-7jc9x"] Jul 06 18:29:29.199366 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.199285 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e982cb-608e-46ce-a590-855e927097dc" containerName="manager" Jul 06 18:29:29.199366 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.199296 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e982cb-608e-46ce-a590-855e927097dc" containerName="manager" Jul 06 18:29:29.199366 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.199350 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e982cb-608e-46ce-a590-855e927097dc" containerName="manager" Jul 06 18:29:29.203213 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.203194 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.207021 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.206998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 18:29:29.207245 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.207231 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hgx44\"" Jul 06 18:29:29.214288 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.214264 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7d886d7d97-7jc9x"] Jul 06 18:29:29.339401 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.339349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg8mk\" (UniqueName: \"kubernetes.io/projected/af86fd22-41b9-4691-b741-46d813955a5c-kube-api-access-pg8mk\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.339588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.339483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af86fd22-41b9-4691-b741-46d813955a5c-maas-api-tls\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.339588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.339535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af86fd22-41b9-4691-b741-46d813955a5c-openshift-service-ca\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.440247 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.440201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af86fd22-41b9-4691-b741-46d813955a5c-maas-api-tls\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.440413 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.440275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af86fd22-41b9-4691-b741-46d813955a5c-openshift-service-ca\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.440413 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.440370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg8mk\" (UniqueName: \"kubernetes.io/projected/af86fd22-41b9-4691-b741-46d813955a5c-kube-api-access-pg8mk\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.441161 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.441134 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af86fd22-41b9-4691-b741-46d813955a5c-openshift-service-ca\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.442899 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.442876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af86fd22-41b9-4691-b741-46d813955a5c-maas-api-tls\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.459609 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.459534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg8mk\" (UniqueName: \"kubernetes.io/projected/af86fd22-41b9-4691-b741-46d813955a5c-kube-api-access-pg8mk\") pod \"maas-api-7d886d7d97-7jc9x\" (UID: \"af86fd22-41b9-4691-b741-46d813955a5c\") " pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.514329 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.514293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:29.660508 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.660481 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7d886d7d97-7jc9x"] Jul 06 18:29:29.662679 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:29:29.662651 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf86fd22_41b9_4691_b741_46d813955a5c.slice/crio-1c3dd597abf1f2e396f6baaebf9bd3dfaf0b1a91ebaa8cd6c7afc0d0e44401fc WatchSource:0}: Error finding container 1c3dd597abf1f2e396f6baaebf9bd3dfaf0b1a91ebaa8cd6c7afc0d0e44401fc: Status 404 returned error can't find the container with id 1c3dd597abf1f2e396f6baaebf9bd3dfaf0b1a91ebaa8cd6c7afc0d0e44401fc Jul 06 18:29:29.879826 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.879720 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr"] Jul 06 18:29:29.886570 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.886410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:29.892130 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.892105 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 18:29:29.892311 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.892109 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g2nsp\"" Jul 06 18:29:29.897222 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:29.897194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr"] Jul 06 18:29:30.045848 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.045778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18462f9b-edd0-4c24-9812-69d8ae2a4557-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.046037 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.045890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x82h\" (UniqueName: \"kubernetes.io/projected/18462f9b-edd0-4c24-9812-69d8ae2a4557-kube-api-access-8x82h\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.146606 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.146573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18462f9b-edd0-4c24-9812-69d8ae2a4557-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.146771 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.146630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x82h\" (UniqueName: \"kubernetes.io/projected/18462f9b-edd0-4c24-9812-69d8ae2a4557-kube-api-access-8x82h\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.147299 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.147278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18462f9b-edd0-4c24-9812-69d8ae2a4557-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.155915 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.155889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x82h\" (UniqueName: \"kubernetes.io/projected/18462f9b-edd0-4c24-9812-69d8ae2a4557-kube-api-access-8x82h\") pod \"payload-pre-processing-59f49fd4f6-gq4nr\" (UID: \"18462f9b-edd0-4c24-9812-69d8ae2a4557\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.181561 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.181522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d886d7d97-7jc9x" event={"ID":"af86fd22-41b9-4691-b741-46d813955a5c","Type":"ContainerStarted","Data":"1c3dd597abf1f2e396f6baaebf9bd3dfaf0b1a91ebaa8cd6c7afc0d0e44401fc"} Jul 06 18:29:30.199479 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.199442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:30.336297 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:30.336257 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr"] Jul 06 18:29:30.340095 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:29:30.340061 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18462f9b_edd0_4c24_9812_69d8ae2a4557.slice/crio-3f9e4c4aabc8058a9f134dec59d05873f84b99b5d09dba7e13f50b1361180608 WatchSource:0}: Error finding container 3f9e4c4aabc8058a9f134dec59d05873f84b99b5d09dba7e13f50b1361180608: Status 404 returned error can't find the container with id 3f9e4c4aabc8058a9f134dec59d05873f84b99b5d09dba7e13f50b1361180608 Jul 06 18:29:31.191126 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:31.191080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" event={"ID":"18462f9b-edd0-4c24-9812-69d8ae2a4557","Type":"ContainerStarted","Data":"3f9e4c4aabc8058a9f134dec59d05873f84b99b5d09dba7e13f50b1361180608"} Jul 06 18:29:32.202034 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:32.201997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d886d7d97-7jc9x" event={"ID":"af86fd22-41b9-4691-b741-46d813955a5c","Type":"ContainerStarted","Data":"b73750c3d4ac8cbc907881200bb5b5a1b99d91635c2b2cbfee9512c83bfb1b32"} Jul 06 18:29:32.202486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:32.202098 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:32.223282 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:32.223227 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7d886d7d97-7jc9x" podStartSLOduration=1.35624622 podStartE2EDuration="3.223209703s" totalImagesPullingTime="1.866963483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:29:32.2224354 +0000 UTC m=+606.300511357" watchObservedRunningTime="2026-07-06 18:29:32.223209703 +0000 UTC m=+606.301285638" Jul 06 18:29:34.212630 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:34.212592 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" event={"ID":"18462f9b-edd0-4c24-9812-69d8ae2a4557","Type":"ContainerStarted","Data":"4365e945b93b59c2fdcd4675cc6a5536debeee517890d9b99c16aef9e8bbc93c"} Jul 06 18:29:34.213083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:34.212729 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:34.230511 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:34.230449 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" podStartSLOduration=2.113225191 podStartE2EDuration="5.230432268s" totalImagesPullingTime="3.117207077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:29:34.229725478 +0000 UTC m=+608.307801431" watchObservedRunningTime="2026-07-06 18:29:34.230432268 +0000 UTC m=+608.308508218" Jul 06 18:29:38.212918 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:38.212888 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7d886d7d97-7jc9x" Jul 06 18:29:39.659805 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:39.659760 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:39.660245 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:39.660013 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" containerID="cri-o://5b2c898ba88e377927e598c59986b2e0bc05569ce754a7c22936e042ccd9e4e0" gracePeriod=30 Jul 06 18:29:41.253617 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.253587 2574 generic.go:356] "Generic (PLEG): container finished" podID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerID="5b2c898ba88e377927e598c59986b2e0bc05569ce754a7c22936e042ccd9e4e0" exitCode=143 Jul 06 18:29:41.254028 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.253658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38d6632f-47a5-459c-8b65-9d77089edbdb","Type":"ContainerDied","Data":"5b2c898ba88e377927e598c59986b2e0bc05569ce754a7c22936e042ccd9e4e0"} Jul 06 18:29:41.699207 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.699186 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:41.754669 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.754639 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfm78\" (UniqueName: \"kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78\") pod \"38d6632f-47a5-459c-8b65-9d77089edbdb\" (UID: \"38d6632f-47a5-459c-8b65-9d77089edbdb\") " Jul 06 18:29:41.756824 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.756779 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78" (OuterVolumeSpecName: "kube-api-access-mfm78") pod "38d6632f-47a5-459c-8b65-9d77089edbdb" (UID: "38d6632f-47a5-459c-8b65-9d77089edbdb"). InnerVolumeSpecName "kube-api-access-mfm78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:29:41.856293 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:41.856202 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfm78\" (UniqueName: \"kubernetes.io/projected/38d6632f-47a5-459c-8b65-9d77089edbdb-kube-api-access-mfm78\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:29:42.259407 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.259366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38d6632f-47a5-459c-8b65-9d77089edbdb","Type":"ContainerDied","Data":"5328fd35eb741c7893c557938097b4a653aa7f93c20fc924cb22d23476a70a1e"} Jul 06 18:29:42.259909 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.259412 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.259909 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.259471 2574 scope.go:117] "RemoveContainer" containerID="5b2c898ba88e377927e598c59986b2e0bc05569ce754a7c22936e042ccd9e4e0" Jul 06 18:29:42.280379 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.280352 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:42.283735 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.283711 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:42.304492 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.304461 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:42.304881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.304865 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" Jul 06 18:29:42.304966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.304884 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" Jul 06 18:29:42.305019 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.304964 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" containerName="keycloak" Jul 06 18:29:42.309214 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.309194 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.312028 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.312011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 06 18:29:42.312131 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.312015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5clg6\"" Jul 06 18:29:42.312360 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.312344 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 06 18:29:42.312443 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.312350 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 06 18:29:42.312443 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.312386 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 06 18:29:42.320137 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.320113 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:42.360111 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.360080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-test-realms\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.360293 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.360138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m66m\" (UniqueName: \"kubernetes.io/projected/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-kube-api-access-8m66m\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.461055 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.461019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-test-realms\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.461238 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.461095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m66m\" (UniqueName: \"kubernetes.io/projected/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-kube-api-access-8m66m\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.461721 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.461701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-test-realms\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.470068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.470045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m66m\" (UniqueName: \"kubernetes.io/projected/3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b-kube-api-access-8m66m\") pod \"maas-keycloak-0\" (UID: \"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b\") " pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.619594 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.619513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:42.755800 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.755752 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 06 18:29:42.758625 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:29:42.758591 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4d669a_2454_4d2b_a013_e8d4d6a4ee4b.slice/crio-a22e3540f409fbb4355983bbf798742649b52ee5a17d142c30b9883b50427cc5 WatchSource:0}: Error finding container a22e3540f409fbb4355983bbf798742649b52ee5a17d142c30b9883b50427cc5: Status 404 returned error can't find the container with id a22e3540f409fbb4355983bbf798742649b52ee5a17d142c30b9883b50427cc5 Jul 06 18:29:42.759966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:42.759945 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:29:43.267253 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.267215 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b","Type":"ContainerStarted","Data":"4c63f4dd9160564590da8db410ba3d3ed2c68432727f41e257c7ed7328dc5fe6"} Jul 06 18:29:43.267704 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.267281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b","Type":"ContainerStarted","Data":"a22e3540f409fbb4355983bbf798742649b52ee5a17d142c30b9883b50427cc5"} Jul 06 18:29:43.289669 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.289618 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.912755523 podStartE2EDuration="1.289600714s" totalImagesPullingTime="376.845191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:29:43.288011722 +0000 UTC m=+617.366087658" watchObservedRunningTime="2026-07-06 18:29:43.289600714 +0000 UTC m=+617.367676648" Jul 06 18:29:43.314245 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.314202 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d6632f-47a5-459c-8b65-9d77089edbdb" path="/var/lib/kubelet/pods/38d6632f-47a5-459c-8b65-9d77089edbdb/volumes" Jul 06 18:29:43.620193 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.620146 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:43.622080 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:43.622040 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:44.620159 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:44.620109 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:45.220842 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:45.220804 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-gq4nr" Jul 06 18:29:45.620865 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:45.620752 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:46.620665 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:46.620594 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:47.620097 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:47.620052 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:48.620113 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:48.620008 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:49.620507 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:49.620450 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:50.620112 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:50.620060 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:51.620503 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:51.620456 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:52.620710 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:52.620668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:52.621223 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:52.620971 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:53.620939 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:53.620886 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:54.622089 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:54.622040 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:55.620130 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:55.620074 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 06 18:29:56.722854 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:56.722813 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 06 18:29:56.737592 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:29:56.737544 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3e4d669a-2454-4d2b-a013-e8d4d6a4ee4b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:30:06.728892 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:06.728854 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 06 18:30:30.240816 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.240766 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp"] Jul 06 18:30:30.245612 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.245586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.248625 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.248604 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 18:30:30.249826 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.249808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-86kpz\"" Jul 06 18:30:30.249916 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.249813 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 18:30:30.249916 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.249885 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 18:30:30.256345 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.256322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp"] Jul 06 18:30:30.301563 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.301563 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee73838-daec-4d41-a210-e68a96da5a11-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.301759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.301759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.301759 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.301881 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.301770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzp8n\" (UniqueName: \"kubernetes.io/projected/8ee73838-daec-4d41-a210-e68a96da5a11-kube-api-access-dzp8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.402965 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.402928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.402965 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.402969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee73838-daec-4d41-a210-e68a96da5a11-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403313 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403313 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403313 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403313 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzp8n\" (UniqueName: \"kubernetes.io/projected/8ee73838-daec-4d41-a210-e68a96da5a11-kube-api-access-dzp8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403545 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403545 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.403638 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.403567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.405266 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.405243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ee73838-daec-4d41-a210-e68a96da5a11-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.405431 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.405416 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee73838-daec-4d41-a210-e68a96da5a11-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.411735 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.411707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzp8n\" (UniqueName: \"kubernetes.io/projected/8ee73838-daec-4d41-a210-e68a96da5a11-kube-api-access-dzp8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dxskp\" (UID: \"8ee73838-daec-4d41-a210-e68a96da5a11\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.556753 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.556654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:30.695553 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:30.695526 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp"] Jul 06 18:30:30.698049 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:30:30.698023 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee73838_daec_4d41_a210_e68a96da5a11.slice/crio-8018a14aee9e2ad5a1c5f077f26b2671bcc4bc2beda9c20d7836deb6ae1abd9f WatchSource:0}: Error finding container 8018a14aee9e2ad5a1c5f077f26b2671bcc4bc2beda9c20d7836deb6ae1abd9f: Status 404 returned error can't find the container with id 8018a14aee9e2ad5a1c5f077f26b2671bcc4bc2beda9c20d7836deb6ae1abd9f Jul 06 18:30:31.534452 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:31.534406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" event={"ID":"8ee73838-daec-4d41-a210-e68a96da5a11","Type":"ContainerStarted","Data":"8018a14aee9e2ad5a1c5f077f26b2671bcc4bc2beda9c20d7836deb6ae1abd9f"} Jul 06 18:30:32.540323 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:32.540283 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" event={"ID":"8ee73838-daec-4d41-a210-e68a96da5a11","Type":"ContainerStarted","Data":"375d3c64adbc181b3dfc483e46b3a2ed26008638f0778345bb2e6210829f31a7"} Jul 06 18:30:32.559110 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:32.559058 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" podStartSLOduration=1.484875193 podStartE2EDuration="2.559042502s" totalImagesPullingTime="1.074167309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:30:32.557130719 +0000 UTC m=+666.635206677" watchObservedRunningTime="2026-07-06 18:30:32.559042502 +0000 UTC m=+666.637118435" Jul 06 18:30:40.557176 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:40.557125 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:40.557588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:40.557212 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:40.569540 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:40.569504 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:40.588829 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:40.588779 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dxskp" Jul 06 18:30:50.946000 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:50.945964 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm"] Jul 06 18:30:50.949275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:50.949258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:50.951998 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:50.951973 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 18:30:50.961227 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:50.961193 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm"] Jul 06 18:30:51.101772 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.101735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn57f\" (UniqueName: \"kubernetes.io/projected/f073019b-bf47-4fe0-8c63-046d1ceaa210-kube-api-access-cn57f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.101956 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.101807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.101956 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.101876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.101956 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.101910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.101956 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.101932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f073019b-bf47-4fe0-8c63-046d1ceaa210-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.102109 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.102018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202633 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn57f\" (UniqueName: \"kubernetes.io/projected/f073019b-bf47-4fe0-8c63-046d1ceaa210-kube-api-access-cn57f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202633 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202633 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f073019b-bf47-4fe0-8c63-046d1ceaa210-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.202908 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.202701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.203163 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.203033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.203163 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.203081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.203163 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.203151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.204985 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.204964 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f073019b-bf47-4fe0-8c63-046d1ceaa210-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.205370 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.205353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f073019b-bf47-4fe0-8c63-046d1ceaa210-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.210745 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.210718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn57f\" (UniqueName: \"kubernetes.io/projected/f073019b-bf47-4fe0-8c63-046d1ceaa210-kube-api-access-cn57f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm\" (UID: \"f073019b-bf47-4fe0-8c63-046d1ceaa210\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.259848 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.259815 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:30:51.392071 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.392044 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm"] Jul 06 18:30:51.394524 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:30:51.394500 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf073019b_bf47_4fe0_8c63_046d1ceaa210.slice/crio-e389cf1d1446def7fc84b2a399e4c6582e05da7684eeacb57188ec240a002cb8 WatchSource:0}: Error finding container e389cf1d1446def7fc84b2a399e4c6582e05da7684eeacb57188ec240a002cb8: Status 404 returned error can't find the container with id e389cf1d1446def7fc84b2a399e4c6582e05da7684eeacb57188ec240a002cb8 Jul 06 18:30:51.630216 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:51.630189 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" event={"ID":"f073019b-bf47-4fe0-8c63-046d1ceaa210","Type":"ContainerStarted","Data":"e389cf1d1446def7fc84b2a399e4c6582e05da7684eeacb57188ec240a002cb8"} Jul 06 18:30:52.636772 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:52.636740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" event={"ID":"f073019b-bf47-4fe0-8c63-046d1ceaa210","Type":"ContainerStarted","Data":"785d958e3392ba81e77b7707c7f50152d0970a9901171272048350e583265145"} Jul 06 18:30:52.659671 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:30:52.659619 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" podStartSLOduration=2.4735685419999998 podStartE2EDuration="2.659601381s" totalImagesPullingTime="186.032839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:30:52.658017528 +0000 UTC m=+686.736093486" watchObservedRunningTime="2026-07-06 18:30:52.659601381 +0000 UTC m=+686.737677315" Jul 06 18:31:01.260350 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:01.260304 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:31:01.260988 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:01.260383 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:31:01.273254 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:01.273226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:31:01.692485 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:01.692451 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm" Jul 06 18:31:13.522050 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.522008 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w"] Jul 06 18:31:13.526377 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.526350 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.529300 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.529274 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 18:31:13.534723 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.534527 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w"] Jul 06 18:31:13.609022 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.608982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.609022 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.609021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjmzt\" (UniqueName: \"kubernetes.io/projected/03f7816e-537d-437f-9394-f7517269d5bd-kube-api-access-tjmzt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.609243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.609045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f7816e-537d-437f-9394-f7517269d5bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.609243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.609144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.609243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.609178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.609243 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.609234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjmzt\" (UniqueName: \"kubernetes.io/projected/03f7816e-537d-437f-9394-f7517269d5bd-kube-api-access-tjmzt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f7816e-537d-437f-9394-f7517269d5bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710365 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710580 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710657 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.710697 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.710676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.712549 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.712527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f7816e-537d-437f-9394-f7517269d5bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.712858 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.712838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f7816e-537d-437f-9394-f7517269d5bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.718691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.718663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjmzt\" (UniqueName: \"kubernetes.io/projected/03f7816e-537d-437f-9394-f7517269d5bd-kube-api-access-tjmzt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w\" (UID: \"03f7816e-537d-437f-9394-f7517269d5bd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.837725 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.837621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:13.973920 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:13.973894 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w"] Jul 06 18:31:13.976560 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:31:13.976529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03f7816e_537d_437f_9394_f7517269d5bd.slice/crio-0f3d0efb03dd7f53a6538dd5977e4b41badc6f35cadab4a83ba57b304ded58d9 WatchSource:0}: Error finding container 0f3d0efb03dd7f53a6538dd5977e4b41badc6f35cadab4a83ba57b304ded58d9: Status 404 returned error can't find the container with id 0f3d0efb03dd7f53a6538dd5977e4b41badc6f35cadab4a83ba57b304ded58d9 Jul 06 18:31:14.748030 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:14.747995 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" event={"ID":"03f7816e-537d-437f-9394-f7517269d5bd","Type":"ContainerStarted","Data":"d2ac86d4b0d8034f1a49924a74d8616a8ce560fc28438b2d6348bd4a8caec7ad"} Jul 06 18:31:14.748446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:14.748040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" event={"ID":"03f7816e-537d-437f-9394-f7517269d5bd","Type":"ContainerStarted","Data":"0f3d0efb03dd7f53a6538dd5977e4b41badc6f35cadab4a83ba57b304ded58d9"} Jul 06 18:31:14.766052 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:14.765994 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" podStartSLOduration=1.597698164 podStartE2EDuration="1.765976949s" totalImagesPullingTime="168.278785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:31:14.764908845 +0000 UTC m=+708.842984802" watchObservedRunningTime="2026-07-06 18:31:14.765976949 +0000 UTC m=+708.844052885" Jul 06 18:31:23.838641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:23.838545 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:23.839070 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:23.838854 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:23.851364 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:23.851334 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:31:24.804100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:31:24.804071 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w" Jul 06 18:33:25.314434 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.314403 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:33:25.314966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.314586 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5cdf75475b-pbd27" podUID="8817b486-017e-4ba8-b0ca-15ab8402d200" containerName="manager" containerID="cri-o://68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491" gracePeriod=30 Jul 06 18:33:25.574099 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.574031 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:33:25.627708 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.627670 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") pod \"8817b486-017e-4ba8-b0ca-15ab8402d200\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " Jul 06 18:33:25.627923 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.627738 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmj74\" (UniqueName: \"kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74\") pod \"8817b486-017e-4ba8-b0ca-15ab8402d200\" (UID: \"8817b486-017e-4ba8-b0ca-15ab8402d200\") " Jul 06 18:33:25.629865 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.629827 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74" (OuterVolumeSpecName: "kube-api-access-kmj74") pod "8817b486-017e-4ba8-b0ca-15ab8402d200" (UID: "8817b486-017e-4ba8-b0ca-15ab8402d200"). InnerVolumeSpecName "kube-api-access-kmj74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:25.629979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.629836 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8817b486-017e-4ba8-b0ca-15ab8402d200" (UID: "8817b486-017e-4ba8-b0ca-15ab8402d200"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:33:25.729025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.728994 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8817b486-017e-4ba8-b0ca-15ab8402d200-webhook-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:33:25.729025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:25.729021 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmj74\" (UniqueName: \"kubernetes.io/projected/8817b486-017e-4ba8-b0ca-15ab8402d200-kube-api-access-kmj74\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:33:26.373966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.373933 2574 generic.go:356] "Generic (PLEG): container finished" podID="8817b486-017e-4ba8-b0ca-15ab8402d200" containerID="68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491" exitCode=0 Jul 06 18:33:26.374387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.373989 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-pbd27" Jul 06 18:33:26.374387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.374024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-pbd27" event={"ID":"8817b486-017e-4ba8-b0ca-15ab8402d200","Type":"ContainerDied","Data":"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491"} Jul 06 18:33:26.374387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.374081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-pbd27" event={"ID":"8817b486-017e-4ba8-b0ca-15ab8402d200","Type":"ContainerDied","Data":"14038d033769e7760c2cd434e32113176c9af937d3694e3f98bc81e9fb7b0201"} Jul 06 18:33:26.374387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.374104 2574 scope.go:117] "RemoveContainer" containerID="68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491" Jul 06 18:33:26.383813 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.383764 2574 scope.go:117] "RemoveContainer" containerID="68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491" Jul 06 18:33:26.384081 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:33:26.384063 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491\": container with ID starting with 68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491 not found: ID does not exist" containerID="68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491" Jul 06 18:33:26.384147 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.384090 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491"} err="failed to get container status \"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491\": rpc error: code = NotFound desc = could not find container \"68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491\": container with ID starting with 68717c387288f47c067eb8061f9a34428d53f57c767d1a36d38d47063676e491 not found: ID does not exist" Jul 06 18:33:26.396641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.396608 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:33:26.400299 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:26.400258 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-pbd27"] Jul 06 18:33:27.193977 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.193944 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdf75475b-t8nlc"] Jul 06 18:33:27.194366 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.194349 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8817b486-017e-4ba8-b0ca-15ab8402d200" containerName="manager" Jul 06 18:33:27.194447 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.194369 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8817b486-017e-4ba8-b0ca-15ab8402d200" containerName="manager" Jul 06 18:33:27.194514 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.194500 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8817b486-017e-4ba8-b0ca-15ab8402d200" containerName="manager" Jul 06 18:33:27.196869 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.196850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.200999 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.200976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtfhd\"" Jul 06 18:33:27.201121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.200976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 18:33:27.201121 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.200989 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 18:33:27.208994 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.208970 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-t8nlc"] Jul 06 18:33:27.242756 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.242709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fba1e27e-32f9-4847-9b32-268e9de8e3bc-webhook-cert\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.242963 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.242781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz84d\" (UniqueName: \"kubernetes.io/projected/fba1e27e-32f9-4847-9b32-268e9de8e3bc-kube-api-access-vz84d\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.313086 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.313049 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8817b486-017e-4ba8-b0ca-15ab8402d200" path="/var/lib/kubelet/pods/8817b486-017e-4ba8-b0ca-15ab8402d200/volumes" Jul 06 18:33:27.343597 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.343560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fba1e27e-32f9-4847-9b32-268e9de8e3bc-webhook-cert\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.343715 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.343608 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz84d\" (UniqueName: \"kubernetes.io/projected/fba1e27e-32f9-4847-9b32-268e9de8e3bc-kube-api-access-vz84d\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.346055 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.346024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fba1e27e-32f9-4847-9b32-268e9de8e3bc-webhook-cert\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.352931 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.352894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz84d\" (UniqueName: \"kubernetes.io/projected/fba1e27e-32f9-4847-9b32-268e9de8e3bc-kube-api-access-vz84d\") pod \"maas-controller-5cdf75475b-t8nlc\" (UID: \"fba1e27e-32f9-4847-9b32-268e9de8e3bc\") " pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.507332 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.507246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:27.643820 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:27.643746 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdf75475b-t8nlc"] Jul 06 18:33:27.646621 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:33:27.646591 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba1e27e_32f9_4847_9b32_268e9de8e3bc.slice/crio-e1f498588e5a95f8c81cfde2fef6daeb64a6ea1aec6e7d36ba3a9313ab427849 WatchSource:0}: Error finding container e1f498588e5a95f8c81cfde2fef6daeb64a6ea1aec6e7d36ba3a9313ab427849: Status 404 returned error can't find the container with id e1f498588e5a95f8c81cfde2fef6daeb64a6ea1aec6e7d36ba3a9313ab427849 Jul 06 18:33:28.386714 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:28.386675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" event={"ID":"fba1e27e-32f9-4847-9b32-268e9de8e3bc","Type":"ContainerStarted","Data":"e1f498588e5a95f8c81cfde2fef6daeb64a6ea1aec6e7d36ba3a9313ab427849"} Jul 06 18:33:29.392968 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:29.392930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" event={"ID":"fba1e27e-32f9-4847-9b32-268e9de8e3bc","Type":"ContainerStarted","Data":"502f9363f4a1907510366bb00e3475247ac8d3f39db154a62a0d1ee5e85ff4c2"} Jul 06 18:33:29.393401 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:29.393033 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:33:29.414729 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:29.414670 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" podStartSLOduration=1.461752043 podStartE2EDuration="2.414652208s" totalImagesPullingTime="952.900165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:33:29.412539068 +0000 UTC m=+843.490615029" watchObservedRunningTime="2026-07-06 18:33:29.414652208 +0000 UTC m=+843.492728143" Jul 06 18:33:40.402419 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:33:40.402384 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdf75475b-t8nlc" Jul 06 18:34:27.243205 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:34:27.243129 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:34:27.250162 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:34:27.250137 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:39:27.273380 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:39:27.273345 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:39:27.279000 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:39:27.278980 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:44:27.304616 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:44:27.304585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:44:27.306982 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:44:27.306957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:45:30.109259 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.109219 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:30.119123 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.119093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.122372 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.122343 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-da476535-serving-cert\"" Jul 06 18:45:30.126213 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.126181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:30.265284 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.265237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.265495 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.265329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rkw\" (UniqueName: \"kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.265495 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.265391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.366552 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.366435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rkw\" (UniqueName: \"kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.366552 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.366539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.366832 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.366656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.366928 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:30.366892 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-da476535-serving-cert: secret "maas-api-e2e-ait-da476535-serving-cert" not found Jul 06 18:45:30.366996 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:30.366968 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls podName:c7dbc604-e978-4218-8d9c-2999d530f9ec nodeName:}" failed. No retries permitted until 2026-07-06 18:45:30.866951571 +0000 UTC m=+1564.945027512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls") pod "maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" (UID: "c7dbc604-e978-4218-8d9c-2999d530f9ec") : secret "maas-api-e2e-ait-da476535-serving-cert" not found Jul 06 18:45:30.367341 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.367322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.378385 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.378357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rkw\" (UniqueName: \"kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.870964 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.870926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:30.873485 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:30.873459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") pod \"maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:31.034301 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.034258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:31.193031 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.192981 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:31.195437 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:45:31.195406 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dbc604_e978_4218_8d9c_2999d530f9ec.slice/crio-e3968957765b57153bcfc8d4902083cb6f84c8be109d76791a08a5d84dca135f WatchSource:0}: Error finding container e3968957765b57153bcfc8d4902083cb6f84c8be109d76791a08a5d84dca135f: Status 404 returned error can't find the container with id e3968957765b57153bcfc8d4902083cb6f84c8be109d76791a08a5d84dca135f Jul 06 18:45:31.196895 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.196872 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:45:31.847196 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.847161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" event={"ID":"c7dbc604-e978-4218-8d9c-2999d530f9ec","Type":"ContainerStarted","Data":"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685"} Jul 06 18:45:31.847387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.847216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" event={"ID":"c7dbc604-e978-4218-8d9c-2999d530f9ec","Type":"ContainerStarted","Data":"e3968957765b57153bcfc8d4902083cb6f84c8be109d76791a08a5d84dca135f"} Jul 06 18:45:31.847387 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.847260 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:31.867588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:31.867531 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" podStartSLOduration=1.375906837 podStartE2EDuration="1.867515949s" totalImagesPullingTime="491.609112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:45:31.86508497 +0000 UTC m=+1565.943160930" watchObservedRunningTime="2026-07-06 18:45:31.867515949 +0000 UTC m=+1565.945591886" Jul 06 18:45:35.488706 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.488666 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:35.489198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.488892 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" podUID="c7dbc604-e978-4218-8d9c-2999d530f9ec" containerName="maas-api" containerID="cri-o://b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685" gracePeriod=30 Jul 06 18:45:35.737285 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.737255 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:35.816236 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.816140 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4rkw\" (UniqueName: \"kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw\") pod \"c7dbc604-e978-4218-8d9c-2999d530f9ec\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " Jul 06 18:45:35.816236 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.816201 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") pod \"c7dbc604-e978-4218-8d9c-2999d530f9ec\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " Jul 06 18:45:35.816236 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.816222 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca\") pod \"c7dbc604-e978-4218-8d9c-2999d530f9ec\" (UID: \"c7dbc604-e978-4218-8d9c-2999d530f9ec\") " Jul 06 18:45:35.816658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.816635 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7dbc604-e978-4218-8d9c-2999d530f9ec" (UID: "c7dbc604-e978-4218-8d9c-2999d530f9ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:45:35.818316 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.818286 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7dbc604-e978-4218-8d9c-2999d530f9ec" (UID: "c7dbc604-e978-4218-8d9c-2999d530f9ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:45:35.818445 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.818366 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw" (OuterVolumeSpecName: "kube-api-access-q4rkw") pod "c7dbc604-e978-4218-8d9c-2999d530f9ec" (UID: "c7dbc604-e978-4218-8d9c-2999d530f9ec"). InnerVolumeSpecName "kube-api-access-q4rkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:45:35.868275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.868228 2574 generic.go:356] "Generic (PLEG): container finished" podID="c7dbc604-e978-4218-8d9c-2999d530f9ec" containerID="b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685" exitCode=0 Jul 06 18:45:35.868473 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.868272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" event={"ID":"c7dbc604-e978-4218-8d9c-2999d530f9ec","Type":"ContainerDied","Data":"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685"} Jul 06 18:45:35.868473 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.868303 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" Jul 06 18:45:35.868473 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.868339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc" event={"ID":"c7dbc604-e978-4218-8d9c-2999d530f9ec","Type":"ContainerDied","Data":"e3968957765b57153bcfc8d4902083cb6f84c8be109d76791a08a5d84dca135f"} Jul 06 18:45:35.868473 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.868362 2574 scope.go:117] "RemoveContainer" containerID="b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685" Jul 06 18:45:35.882126 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.882002 2574 scope.go:117] "RemoveContainer" containerID="b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685" Jul 06 18:45:35.882588 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:35.882558 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685\": container with ID starting with b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685 not found: ID does not exist" containerID="b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685" Jul 06 18:45:35.882666 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.882599 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685"} err="failed to get container status \"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685\": rpc error: code = NotFound desc = could not find container \"b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685\": container with ID starting with b27bd2621bb0fa258a3259f08b709e92573623f1f6803d0a98706d92c01a9685 not found: ID does not exist" Jul 06 18:45:35.893973 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.893937 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:35.897383 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.897354 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-da476535-5df6cccfc7-5kjxc"] Jul 06 18:45:35.917504 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.917468 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4rkw\" (UniqueName: \"kubernetes.io/projected/c7dbc604-e978-4218-8d9c-2999d530f9ec-kube-api-access-q4rkw\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:35.917504 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.917501 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7dbc604-e978-4218-8d9c-2999d530f9ec-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:35.917504 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:35.917512 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dbc604-e978-4218-8d9c-2999d530f9ec-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:37.315152 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:37.315110 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7dbc604-e978-4218-8d9c-2999d530f9ec" path="/var/lib/kubelet/pods/c7dbc604-e978-4218-8d9c-2999d530f9ec/volumes" Jul 06 18:45:42.615045 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.615007 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:42.615539 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.615416 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7dbc604-e978-4218-8d9c-2999d530f9ec" containerName="maas-api" Jul 06 18:45:42.615539 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.615430 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7dbc604-e978-4218-8d9c-2999d530f9ec" containerName="maas-api" Jul 06 18:45:42.615539 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.615506 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7dbc604-e978-4218-8d9c-2999d530f9ec" containerName="maas-api" Jul 06 18:45:42.620125 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.620095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.623254 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.623220 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a5159a6f-serving-cert\"" Jul 06 18:45:42.628771 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.628740 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:42.780180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.780145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.780180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.780184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4p99\" (UniqueName: \"kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.780424 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.780209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.881887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.881769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.881887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.881828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4p99\" (UniqueName: \"kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.882140 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.881955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.882140 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:42.881966 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a5159a6f-serving-cert: secret "maas-api-e2e-ait-a5159a6f-serving-cert" not found Jul 06 18:45:42.882140 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:42.882043 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls podName:e5161709-7796-4f06-8cb1-b8be41dee4cc nodeName:}" failed. No retries permitted until 2026-07-06 18:45:43.382019317 +0000 UTC m=+1577.460095247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls") pod "maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" (UID: "e5161709-7796-4f06-8cb1-b8be41dee4cc") : secret "maas-api-e2e-ait-a5159a6f-serving-cert" not found Jul 06 18:45:42.882660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.882637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:42.893263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:42.893229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4p99\" (UniqueName: \"kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:43.386928 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:43.386888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:43.389446 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:43.389410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") pod \"maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:43.534061 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:43.534023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:43.683039 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:43.683011 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:43.685253 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:45:43.685214 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5161709_7796_4f06_8cb1_b8be41dee4cc.slice/crio-ef0c07200979f4b70db1b5f1ab3ffc12b7d8bc00352f023acfe06c7738544e30 WatchSource:0}: Error finding container ef0c07200979f4b70db1b5f1ab3ffc12b7d8bc00352f023acfe06c7738544e30: Status 404 returned error can't find the container with id ef0c07200979f4b70db1b5f1ab3ffc12b7d8bc00352f023acfe06c7738544e30 Jul 06 18:45:43.909710 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:43.909673 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" event={"ID":"e5161709-7796-4f06-8cb1-b8be41dee4cc","Type":"ContainerStarted","Data":"ef0c07200979f4b70db1b5f1ab3ffc12b7d8bc00352f023acfe06c7738544e30"} Jul 06 18:45:44.916392 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:44.916356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" event={"ID":"e5161709-7796-4f06-8cb1-b8be41dee4cc","Type":"ContainerStarted","Data":"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe"} Jul 06 18:45:44.916850 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:44.916440 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:44.933313 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:44.933252 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" podStartSLOduration=2.572189953 podStartE2EDuration="2.933231422s" totalImagesPullingTime="361.041469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:45:44.933185674 +0000 UTC m=+1579.011261611" watchObservedRunningTime="2026-07-06 18:45:44.933231422 +0000 UTC m=+1579.011307361" Jul 06 18:45:47.929144 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:47.929107 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:47.929646 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:47.929349 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" podUID="e5161709-7796-4f06-8cb1-b8be41dee4cc" containerName="maas-api" containerID="cri-o://a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe" gracePeriod=30 Jul 06 18:45:48.188472 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.188396 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:48.232929 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.232889 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") pod \"e5161709-7796-4f06-8cb1-b8be41dee4cc\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " Jul 06 18:45:48.233145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.232948 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4p99\" (UniqueName: \"kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99\") pod \"e5161709-7796-4f06-8cb1-b8be41dee4cc\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " Jul 06 18:45:48.233145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.232979 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca\") pod \"e5161709-7796-4f06-8cb1-b8be41dee4cc\" (UID: \"e5161709-7796-4f06-8cb1-b8be41dee4cc\") " Jul 06 18:45:48.233520 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.233487 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5161709-7796-4f06-8cb1-b8be41dee4cc" (UID: "e5161709-7796-4f06-8cb1-b8be41dee4cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:45:48.235192 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.235159 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5161709-7796-4f06-8cb1-b8be41dee4cc" (UID: "e5161709-7796-4f06-8cb1-b8be41dee4cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:45:48.235279 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.235175 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99" (OuterVolumeSpecName: "kube-api-access-w4p99") pod "e5161709-7796-4f06-8cb1-b8be41dee4cc" (UID: "e5161709-7796-4f06-8cb1-b8be41dee4cc"). InnerVolumeSpecName "kube-api-access-w4p99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:45:48.333966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.333921 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5161709-7796-4f06-8cb1-b8be41dee4cc-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:48.333966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.333959 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4p99\" (UniqueName: \"kubernetes.io/projected/e5161709-7796-4f06-8cb1-b8be41dee4cc-kube-api-access-w4p99\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:48.333966 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.333971 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5161709-7796-4f06-8cb1-b8be41dee4cc-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:45:48.939129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.939095 2574 generic.go:356] "Generic (PLEG): container finished" podID="e5161709-7796-4f06-8cb1-b8be41dee4cc" containerID="a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe" exitCode=0 Jul 06 18:45:48.939551 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.939152 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" Jul 06 18:45:48.939551 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.939171 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" event={"ID":"e5161709-7796-4f06-8cb1-b8be41dee4cc","Type":"ContainerDied","Data":"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe"} Jul 06 18:45:48.939551 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.939225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4" event={"ID":"e5161709-7796-4f06-8cb1-b8be41dee4cc","Type":"ContainerDied","Data":"ef0c07200979f4b70db1b5f1ab3ffc12b7d8bc00352f023acfe06c7738544e30"} Jul 06 18:45:48.939551 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.939247 2574 scope.go:117] "RemoveContainer" containerID="a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe" Jul 06 18:45:48.948907 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.948888 2574 scope.go:117] "RemoveContainer" containerID="a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe" Jul 06 18:45:48.949235 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:45:48.949215 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe\": container with ID starting with a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe not found: ID does not exist" containerID="a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe" Jul 06 18:45:48.949304 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.949246 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe"} err="failed to get container status \"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe\": rpc error: code = NotFound desc = could not find container \"a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe\": container with ID starting with a641620fefcb493013381c1460dcd85193204afad1b8ad275d72945e3bc992fe not found: ID does not exist" Jul 06 18:45:48.961892 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.961858 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:48.963671 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:48.963649 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5159a6f-7b66c55f98-v9gk4"] Jul 06 18:45:49.313119 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:45:49.313034 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5161709-7796-4f06-8cb1-b8be41dee4cc" path="/var/lib/kubelet/pods/e5161709-7796-4f06-8cb1-b8be41dee4cc/volumes" Jul 06 18:46:01.382023 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.381983 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:01.382580 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.382522 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5161709-7796-4f06-8cb1-b8be41dee4cc" containerName="maas-api" Jul 06 18:46:01.382580 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.382540 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5161709-7796-4f06-8cb1-b8be41dee4cc" containerName="maas-api" Jul 06 18:46:01.382686 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.382650 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5161709-7796-4f06-8cb1-b8be41dee4cc" containerName="maas-api" Jul 06 18:46:01.385661 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.385637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.388167 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.388148 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-173ca26a-serving-cert\"" Jul 06 18:46:01.402765 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.402719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:01.451088 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.451042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.451275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.451117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.451275 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.451141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv7v6\" (UniqueName: \"kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.551988 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.551946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.551988 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.551988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv7v6\" (UniqueName: \"kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.552209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.552050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.552209 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:46:01.552158 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-173ca26a-serving-cert: secret "maas-api-e2e-derive-173ca26a-serving-cert" not found Jul 06 18:46:01.552310 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:46:01.552225 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls podName:4db7c35b-6b58-4ae7-8195-fd511f955052 nodeName:}" failed. No retries permitted until 2026-07-06 18:46:02.052207971 +0000 UTC m=+1596.130283884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls") pod "maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" (UID: "4db7c35b-6b58-4ae7-8195-fd511f955052") : secret "maas-api-e2e-derive-173ca26a-serving-cert" not found Jul 06 18:46:01.552616 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.552595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:01.561240 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:01.561207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv7v6\" (UniqueName: \"kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:02.057290 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:02.057252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:02.059734 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:02.059712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") pod \"maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:02.297972 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:02.297930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:02.445100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:02.445070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:02.447320 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:46:02.447285 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db7c35b_6b58_4ae7_8195_fd511f955052.slice/crio-6800dc195a82048c565b48dc68e8ab157501b4c5ee2a3eef84587e6f0cd9c51e WatchSource:0}: Error finding container 6800dc195a82048c565b48dc68e8ab157501b4c5ee2a3eef84587e6f0cd9c51e: Status 404 returned error can't find the container with id 6800dc195a82048c565b48dc68e8ab157501b4c5ee2a3eef84587e6f0cd9c51e Jul 06 18:46:03.008702 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:03.008667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" event={"ID":"4db7c35b-6b58-4ae7-8195-fd511f955052","Type":"ContainerStarted","Data":"6800dc195a82048c565b48dc68e8ab157501b4c5ee2a3eef84587e6f0cd9c51e"} Jul 06 18:46:04.014950 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:04.014907 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" event={"ID":"4db7c35b-6b58-4ae7-8195-fd511f955052","Type":"ContainerStarted","Data":"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2"} Jul 06 18:46:04.015358 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:04.015013 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:04.032398 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:04.032344 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" podStartSLOduration=2.3683968 podStartE2EDuration="3.032325061s" totalImagesPullingTime="663.928261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:46:04.031525565 +0000 UTC m=+1598.109601504" watchObservedRunningTime="2026-07-06 18:46:04.032325061 +0000 UTC m=+1598.110400997" Jul 06 18:46:06.164500 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.164465 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:06.165045 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.164698 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" podUID="4db7c35b-6b58-4ae7-8195-fd511f955052" containerName="maas-api" containerID="cri-o://bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2" gracePeriod=30 Jul 06 18:46:06.425059 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.424976 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:06.500209 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.500173 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca\") pod \"4db7c35b-6b58-4ae7-8195-fd511f955052\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " Jul 06 18:46:06.500484 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.500253 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") pod \"4db7c35b-6b58-4ae7-8195-fd511f955052\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " Jul 06 18:46:06.500484 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.500318 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv7v6\" (UniqueName: \"kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6\") pod \"4db7c35b-6b58-4ae7-8195-fd511f955052\" (UID: \"4db7c35b-6b58-4ae7-8195-fd511f955052\") " Jul 06 18:46:06.500643 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.500613 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4db7c35b-6b58-4ae7-8195-fd511f955052" (UID: "4db7c35b-6b58-4ae7-8195-fd511f955052"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:46:06.502464 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.502432 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4db7c35b-6b58-4ae7-8195-fd511f955052" (UID: "4db7c35b-6b58-4ae7-8195-fd511f955052"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:46:06.502641 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.502605 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6" (OuterVolumeSpecName: "kube-api-access-hv7v6") pod "4db7c35b-6b58-4ae7-8195-fd511f955052" (UID: "4db7c35b-6b58-4ae7-8195-fd511f955052"). InnerVolumeSpecName "kube-api-access-hv7v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:46:06.602039 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.601985 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv7v6\" (UniqueName: \"kubernetes.io/projected/4db7c35b-6b58-4ae7-8195-fd511f955052-kube-api-access-hv7v6\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:46:06.602039 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.602030 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4db7c35b-6b58-4ae7-8195-fd511f955052-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:46:06.602039 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:06.602040 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4db7c35b-6b58-4ae7-8195-fd511f955052-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:46:07.031540 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.031503 2574 generic.go:356] "Generic (PLEG): container finished" podID="4db7c35b-6b58-4ae7-8195-fd511f955052" containerID="bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2" exitCode=0 Jul 06 18:46:07.031731 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.031551 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" Jul 06 18:46:07.031731 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.031594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" event={"ID":"4db7c35b-6b58-4ae7-8195-fd511f955052","Type":"ContainerDied","Data":"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2"} Jul 06 18:46:07.031731 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.031654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8" event={"ID":"4db7c35b-6b58-4ae7-8195-fd511f955052","Type":"ContainerDied","Data":"6800dc195a82048c565b48dc68e8ab157501b4c5ee2a3eef84587e6f0cd9c51e"} Jul 06 18:46:07.031731 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.031687 2574 scope.go:117] "RemoveContainer" containerID="bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2" Jul 06 18:46:07.041829 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.041811 2574 scope.go:117] "RemoveContainer" containerID="bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2" Jul 06 18:46:07.042146 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:46:07.042119 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2\": container with ID starting with bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2 not found: ID does not exist" containerID="bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2" Jul 06 18:46:07.042192 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.042147 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2"} err="failed to get container status \"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2\": rpc error: code = NotFound desc = could not find container \"bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2\": container with ID starting with bf1c9b9c9de6a6d64918276250b35cde959e9857a58531eaabba7861a82799d2 not found: ID does not exist" Jul 06 18:46:07.055202 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.055173 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:07.060548 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.060513 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-173ca26a-6fbbd9669f-7lsw8"] Jul 06 18:46:07.318438 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:46:07.318353 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db7c35b-6b58-4ae7-8195-fd511f955052" path="/var/lib/kubelet/pods/4db7c35b-6b58-4ae7-8195-fd511f955052/volumes" Jul 06 18:48:01.692774 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.692687 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:01.693291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.693274 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db7c35b-6b58-4ae7-8195-fd511f955052" containerName="maas-api" Jul 06 18:48:01.693339 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.693294 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db7c35b-6b58-4ae7-8195-fd511f955052" containerName="maas-api" Jul 06 18:48:01.693422 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.693409 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db7c35b-6b58-4ae7-8195-fd511f955052" containerName="maas-api" Jul 06 18:48:01.696532 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.696514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.701752 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.701725 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-1732de50-serving-cert\"" Jul 06 18:48:01.710057 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.710025 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:01.871464 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.871415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.871660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.871572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svtj5\" (UniqueName: \"kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.871660 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.871618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.972483 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.972379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.972483 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.972481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svtj5\" (UniqueName: \"kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.972700 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.972506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.972700 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:48:01.972547 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-1732de50-serving-cert: secret "maas-api-e2e-mt-1732de50-serving-cert" not found Jul 06 18:48:01.972700 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:48:01.972642 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls podName:a11413ce-6872-4440-b27d-d8ea1b85687a nodeName:}" failed. No retries permitted until 2026-07-06 18:48:02.472622802 +0000 UTC m=+1716.550698719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls") pod "maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" (UID: "a11413ce-6872-4440-b27d-d8ea1b85687a") : secret "maas-api-e2e-mt-1732de50-serving-cert" not found Jul 06 18:48:01.973145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.973127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:01.993924 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:01.993894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svtj5\" (UniqueName: \"kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:02.477094 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:02.477053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:02.479520 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:02.479496 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") pod \"maas-api-e2e-mt-1732de50-694ffdd94d-trxbp\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:02.607082 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:02.607039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:02.755911 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:02.755825 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:02.759363 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:48:02.759321 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11413ce_6872_4440_b27d_d8ea1b85687a.slice/crio-8a5f476d1f2c9b2aad01a5b2864617af7276ae383cde8257938ad6e28acae0e1 WatchSource:0}: Error finding container 8a5f476d1f2c9b2aad01a5b2864617af7276ae383cde8257938ad6e28acae0e1: Status 404 returned error can't find the container with id 8a5f476d1f2c9b2aad01a5b2864617af7276ae383cde8257938ad6e28acae0e1 Jul 06 18:48:03.605970 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:03.605876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" event={"ID":"a11413ce-6872-4440-b27d-d8ea1b85687a","Type":"ContainerStarted","Data":"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b"} Jul 06 18:48:03.605970 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:03.605927 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" event={"ID":"a11413ce-6872-4440-b27d-d8ea1b85687a","Type":"ContainerStarted","Data":"8a5f476d1f2c9b2aad01a5b2864617af7276ae383cde8257938ad6e28acae0e1"} Jul 06 18:48:03.605970 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:03.605950 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:03.634148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:03.634095 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" podStartSLOduration=2.160659649 podStartE2EDuration="2.634081014s" totalImagesPullingTime="473.421365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:48:03.632614652 +0000 UTC m=+1717.710690611" watchObservedRunningTime="2026-07-06 18:48:03.634081014 +0000 UTC m=+1717.712156952" Jul 06 18:48:09.617016 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:09.616986 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:14.101156 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.101117 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:14.101605 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.101360 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" podUID="a11413ce-6872-4440-b27d-d8ea1b85687a" containerName="maas-api" containerID="cri-o://e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b" gracePeriod=30 Jul 06 18:48:14.351509 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.351440 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:14.389305 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.389273 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") pod \"a11413ce-6872-4440-b27d-d8ea1b85687a\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " Jul 06 18:48:14.389493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.389360 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svtj5\" (UniqueName: \"kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5\") pod \"a11413ce-6872-4440-b27d-d8ea1b85687a\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " Jul 06 18:48:14.389493 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.389395 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca\") pod \"a11413ce-6872-4440-b27d-d8ea1b85687a\" (UID: \"a11413ce-6872-4440-b27d-d8ea1b85687a\") " Jul 06 18:48:14.389853 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.389827 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a11413ce-6872-4440-b27d-d8ea1b85687a" (UID: "a11413ce-6872-4440-b27d-d8ea1b85687a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:48:14.391415 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.391384 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5" (OuterVolumeSpecName: "kube-api-access-svtj5") pod "a11413ce-6872-4440-b27d-d8ea1b85687a" (UID: "a11413ce-6872-4440-b27d-d8ea1b85687a"). InnerVolumeSpecName "kube-api-access-svtj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:48:14.391503 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.391467 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a11413ce-6872-4440-b27d-d8ea1b85687a" (UID: "a11413ce-6872-4440-b27d-d8ea1b85687a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:48:14.490254 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.490219 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a11413ce-6872-4440-b27d-d8ea1b85687a-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:48:14.490254 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.490255 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svtj5\" (UniqueName: \"kubernetes.io/projected/a11413ce-6872-4440-b27d-d8ea1b85687a-kube-api-access-svtj5\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:48:14.490463 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.490272 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a11413ce-6872-4440-b27d-d8ea1b85687a-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:48:14.661305 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.661269 2574 generic.go:356] "Generic (PLEG): container finished" podID="a11413ce-6872-4440-b27d-d8ea1b85687a" containerID="e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b" exitCode=0 Jul 06 18:48:14.661486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.661319 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" Jul 06 18:48:14.661486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.661333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" event={"ID":"a11413ce-6872-4440-b27d-d8ea1b85687a","Type":"ContainerDied","Data":"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b"} Jul 06 18:48:14.661486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.661375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp" event={"ID":"a11413ce-6872-4440-b27d-d8ea1b85687a","Type":"ContainerDied","Data":"8a5f476d1f2c9b2aad01a5b2864617af7276ae383cde8257938ad6e28acae0e1"} Jul 06 18:48:14.661486 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.661402 2574 scope.go:117] "RemoveContainer" containerID="e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b" Jul 06 18:48:14.670844 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.670820 2574 scope.go:117] "RemoveContainer" containerID="e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b" Jul 06 18:48:14.671140 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:48:14.671118 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b\": container with ID starting with e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b not found: ID does not exist" containerID="e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b" Jul 06 18:48:14.671198 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.671149 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b"} err="failed to get container status \"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b\": rpc error: code = NotFound desc = could not find container \"e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b\": container with ID starting with e43287dbb334b922ce24a99d3a871bcac8f0d1ba4144ff908f78b718d399cd5b not found: ID does not exist" Jul 06 18:48:14.684338 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.684304 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:14.688691 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:14.688664 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-1732de50-694ffdd94d-trxbp"] Jul 06 18:48:15.312628 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:15.312592 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11413ce-6872-4440-b27d-d8ea1b85687a" path="/var/lib/kubelet/pods/a11413ce-6872-4440-b27d-d8ea1b85687a/volumes" Jul 06 18:48:43.675145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.675109 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:48:43.675624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.675485 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11413ce-6872-4440-b27d-d8ea1b85687a" containerName="maas-api" Jul 06 18:48:43.675624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.675497 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11413ce-6872-4440-b27d-d8ea1b85687a" containerName="maas-api" Jul 06 18:48:43.675624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.675562 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11413ce-6872-4440-b27d-d8ea1b85687a" containerName="maas-api" Jul 06 18:48:43.678772 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.678751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.681675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.681655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f8683f4a-serving-cert\"" Jul 06 18:48:43.691143 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.691117 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:48:43.779026 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.778992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.779245 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.779042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.779245 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.779133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqz8s\" (UniqueName: \"kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.880361 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.880311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqz8s\" (UniqueName: \"kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.880556 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.880410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.880556 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.880445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.880556 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:48:43.880548 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-f8683f4a-serving-cert: secret "maas-api-e2e-mt-f8683f4a-serving-cert" not found Jul 06 18:48:43.880682 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:48:43.880618 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls podName:80ce19ea-8c01-42c3-b503-01ac59b01782 nodeName:}" failed. No retries permitted until 2026-07-06 18:48:44.380596337 +0000 UTC m=+1758.458672258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls") pod "maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" (UID: "80ce19ea-8c01-42c3-b503-01ac59b01782") : secret "maas-api-e2e-mt-f8683f4a-serving-cert" not found Jul 06 18:48:43.881067 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.881048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:43.889186 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:43.889160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqz8s\" (UniqueName: \"kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:44.384679 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:44.384639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:44.387174 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:44.387154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") pod \"maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:44.589137 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:44.589101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:44.730658 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:44.730592 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:48:44.733287 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:48:44.733257 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ce19ea_8c01_42c3_b503_01ac59b01782.slice/crio-ec2564a44e7719fdd66ebdcae0b32db81fce8188eae4b82bc6a28b32d50760af WatchSource:0}: Error finding container ec2564a44e7719fdd66ebdcae0b32db81fce8188eae4b82bc6a28b32d50760af: Status 404 returned error can't find the container with id ec2564a44e7719fdd66ebdcae0b32db81fce8188eae4b82bc6a28b32d50760af Jul 06 18:48:44.806278 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:44.806240 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" event={"ID":"80ce19ea-8c01-42c3-b503-01ac59b01782","Type":"ContainerStarted","Data":"ec2564a44e7719fdd66ebdcae0b32db81fce8188eae4b82bc6a28b32d50760af"} Jul 06 18:48:45.813279 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:45.813242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" event={"ID":"80ce19ea-8c01-42c3-b503-01ac59b01782","Type":"ContainerStarted","Data":"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9"} Jul 06 18:48:45.813683 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:45.813379 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:48:45.834696 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:45.834643 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" podStartSLOduration=2.480454484 podStartE2EDuration="2.83462659s" totalImagesPullingTime="354.172106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:48:45.833414801 +0000 UTC m=+1759.911490736" watchObservedRunningTime="2026-07-06 18:48:45.83462659 +0000 UTC m=+1759.912702526" Jul 06 18:48:51.823117 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:48:51.823086 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:49:27.338528 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:27.338500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:49:27.339049 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:27.338500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:49:31.441028 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.440985 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:49:31.441519 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.441245 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" podUID="80ce19ea-8c01-42c3-b503-01ac59b01782" containerName="maas-api" containerID="cri-o://28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9" gracePeriod=30 Jul 06 18:49:31.693623 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.693550 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:49:31.733985 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.733951 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") pod \"80ce19ea-8c01-42c3-b503-01ac59b01782\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " Jul 06 18:49:31.734179 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.734011 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca\") pod \"80ce19ea-8c01-42c3-b503-01ac59b01782\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " Jul 06 18:49:31.734179 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.734057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqz8s\" (UniqueName: \"kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s\") pod \"80ce19ea-8c01-42c3-b503-01ac59b01782\" (UID: \"80ce19ea-8c01-42c3-b503-01ac59b01782\") " Jul 06 18:49:31.734409 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.734378 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80ce19ea-8c01-42c3-b503-01ac59b01782" (UID: "80ce19ea-8c01-42c3-b503-01ac59b01782"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:49:31.736158 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.736126 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80ce19ea-8c01-42c3-b503-01ac59b01782" (UID: "80ce19ea-8c01-42c3-b503-01ac59b01782"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:49:31.736270 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.736179 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s" (OuterVolumeSpecName: "kube-api-access-vqz8s") pod "80ce19ea-8c01-42c3-b503-01ac59b01782" (UID: "80ce19ea-8c01-42c3-b503-01ac59b01782"). InnerVolumeSpecName "kube-api-access-vqz8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:49:31.835180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.835139 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ce19ea-8c01-42c3-b503-01ac59b01782-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:49:31.835180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.835173 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ce19ea-8c01-42c3-b503-01ac59b01782-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:49:31.835180 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:31.835185 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqz8s\" (UniqueName: \"kubernetes.io/projected/80ce19ea-8c01-42c3-b503-01ac59b01782-kube-api-access-vqz8s\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:49:32.036853 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.036726 2574 generic.go:356] "Generic (PLEG): container finished" podID="80ce19ea-8c01-42c3-b503-01ac59b01782" containerID="28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9" exitCode=0 Jul 06 18:49:32.036853 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.036772 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" Jul 06 18:49:32.037087 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.036772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" event={"ID":"80ce19ea-8c01-42c3-b503-01ac59b01782","Type":"ContainerDied","Data":"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9"} Jul 06 18:49:32.037087 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.036926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g" event={"ID":"80ce19ea-8c01-42c3-b503-01ac59b01782","Type":"ContainerDied","Data":"ec2564a44e7719fdd66ebdcae0b32db81fce8188eae4b82bc6a28b32d50760af"} Jul 06 18:49:32.037087 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.036959 2574 scope.go:117] "RemoveContainer" containerID="28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9" Jul 06 18:49:32.046330 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.046309 2574 scope.go:117] "RemoveContainer" containerID="28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9" Jul 06 18:49:32.046644 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:49:32.046622 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9\": container with ID starting with 28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9 not found: ID does not exist" containerID="28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9" Jul 06 18:49:32.046696 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.046653 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9"} err="failed to get container status \"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9\": rpc error: code = NotFound desc = could not find container \"28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9\": container with ID starting with 28696be63be909a449702af381bc383df19ea7787db699340570b17cc24c4bb9 not found: ID does not exist" Jul 06 18:49:32.061859 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.061828 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:49:32.065263 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:32.065238 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f8683f4a-86c54c7d67-xng8g"] Jul 06 18:49:33.312806 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:49:33.312765 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ce19ea-8c01-42c3-b503-01ac59b01782" path="/var/lib/kubelet/pods/80ce19ea-8c01-42c3-b503-01ac59b01782/volumes" Jul 06 18:51:23.760596 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.760550 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:51:23.761197 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.761165 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ce19ea-8c01-42c3-b503-01ac59b01782" containerName="maas-api" Jul 06 18:51:23.761197 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.761187 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ce19ea-8c01-42c3-b503-01ac59b01782" containerName="maas-api" Jul 06 18:51:23.761329 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.761314 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ce19ea-8c01-42c3-b503-01ac59b01782" containerName="maas-api" Jul 06 18:51:23.764521 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.764496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.770934 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.770906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-f2348c-serving-cert\"" Jul 06 18:51:23.780068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.780033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:51:23.892284 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.892241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2jhh\" (UniqueName: \"kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.892284 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.892289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.892524 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.892412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.993700 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.993654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.993943 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.993756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2jhh\" (UniqueName: \"kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.993943 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.993814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:23.993943 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:51:23.993841 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-f2348c-serving-cert: secret "maas-api-e2e-inf-a-f2348c-serving-cert" not found Jul 06 18:51:23.993943 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:51:23.993916 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls podName:46c829a8-f25d-40c4-a7db-a83b8240cfaa nodeName:}" failed. No retries permitted until 2026-07-06 18:51:24.493898577 +0000 UTC m=+1918.571974491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls") pod "maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" (UID: "46c829a8-f25d-40c4-a7db-a83b8240cfaa") : secret "maas-api-e2e-inf-a-f2348c-serving-cert" not found Jul 06 18:51:23.994534 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:23.994512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:24.002976 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.002955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2jhh\" (UniqueName: \"kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:24.499708 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.499665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:24.502231 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.502197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") pod \"maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:24.675943 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.675905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:24.818418 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.818390 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:51:24.822134 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:51:24.822104 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c829a8_f25d_40c4_a7db_a83b8240cfaa.slice/crio-fb1fcbaee96db13a4375ec09c27c7a72e6a80589cb0ae6f0201b4fe2ce136a0a WatchSource:0}: Error finding container fb1fcbaee96db13a4375ec09c27c7a72e6a80589cb0ae6f0201b4fe2ce136a0a: Status 404 returned error can't find the container with id fb1fcbaee96db13a4375ec09c27c7a72e6a80589cb0ae6f0201b4fe2ce136a0a Jul 06 18:51:24.823359 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:24.823337 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:51:25.602222 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:25.602183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" event={"ID":"46c829a8-f25d-40c4-a7db-a83b8240cfaa","Type":"ContainerStarted","Data":"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761"} Jul 06 18:51:25.602403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:25.602238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" event={"ID":"46c829a8-f25d-40c4-a7db-a83b8240cfaa","Type":"ContainerStarted","Data":"fb1fcbaee96db13a4375ec09c27c7a72e6a80589cb0ae6f0201b4fe2ce136a0a"} Jul 06 18:51:25.602403 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:25.602268 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:25.624968 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:25.624914 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" podStartSLOduration=2.03661673 podStartE2EDuration="2.624896408s" totalImagesPullingTime="588.279678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:51:25.622842983 +0000 UTC m=+1919.700918941" watchObservedRunningTime="2026-07-06 18:51:25.624896408 +0000 UTC m=+1919.702972344" Jul 06 18:51:31.612021 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.611992 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:51:31.810008 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.809969 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:51:31.814084 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.814056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.817151 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.817127 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-ef5ef7-serving-cert\"" Jul 06 18:51:31.828945 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.828909 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:51:31.869322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.869219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.869322 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.869260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcbk2\" (UniqueName: \"kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.869535 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.869377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.970385 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.970350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.970599 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.970461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.970599 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.970492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbk2\" (UniqueName: \"kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.971159 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.971124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.973267 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.973245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:31.979819 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:31.979761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcbk2\" (UniqueName: \"kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2\") pod \"maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:32.130125 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:32.130024 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:32.280706 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:32.280666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:51:32.283597 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:51:32.283565 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b801d7a_82ff_44a2_b964_9dafaba11a24.slice/crio-488ef8117b345bb8c36a4095ddc431760385fb222e8d9b48030bf78496270e6c WatchSource:0}: Error finding container 488ef8117b345bb8c36a4095ddc431760385fb222e8d9b48030bf78496270e6c: Status 404 returned error can't find the container with id 488ef8117b345bb8c36a4095ddc431760385fb222e8d9b48030bf78496270e6c Jul 06 18:51:32.637013 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:32.636974 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" event={"ID":"5b801d7a-82ff-44a2-b964-9dafaba11a24","Type":"ContainerStarted","Data":"488ef8117b345bb8c36a4095ddc431760385fb222e8d9b48030bf78496270e6c"} Jul 06 18:51:33.643677 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:33.643643 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" event={"ID":"5b801d7a-82ff-44a2-b964-9dafaba11a24","Type":"ContainerStarted","Data":"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60"} Jul 06 18:51:33.644102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:33.643732 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:51:33.662482 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:33.662432 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" podStartSLOduration=2.18579646 podStartE2EDuration="2.662417205s" totalImagesPullingTime="476.620745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:51:33.661545635 +0000 UTC m=+1927.739621571" watchObservedRunningTime="2026-07-06 18:51:33.662417205 +0000 UTC m=+1927.740493140" Jul 06 18:51:39.653828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:51:39.653780 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:52:57.783965 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:57.783929 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:52:57.784570 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:57.784167 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" podUID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" containerName="maas-api" containerID="cri-o://7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761" gracePeriod=30 Jul 06 18:52:58.045432 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.045371 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:52:58.049960 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.049933 2574 generic.go:356] "Generic (PLEG): container finished" podID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" containerID="7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761" exitCode=0 Jul 06 18:52:58.050090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.049986 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" Jul 06 18:52:58.050090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.049996 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" event={"ID":"46c829a8-f25d-40c4-a7db-a83b8240cfaa","Type":"ContainerDied","Data":"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761"} Jul 06 18:52:58.050090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.050037 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq" event={"ID":"46c829a8-f25d-40c4-a7db-a83b8240cfaa","Type":"ContainerDied","Data":"fb1fcbaee96db13a4375ec09c27c7a72e6a80589cb0ae6f0201b4fe2ce136a0a"} Jul 06 18:52:58.050090 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.050058 2574 scope.go:117] "RemoveContainer" containerID="7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761" Jul 06 18:52:58.058706 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.058682 2574 scope.go:117] "RemoveContainer" containerID="7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761" Jul 06 18:52:58.059038 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:52:58.059020 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761\": container with ID starting with 7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761 not found: ID does not exist" containerID="7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761" Jul 06 18:52:58.059125 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.059045 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761"} err="failed to get container status \"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761\": rpc error: code = NotFound desc = could not find container \"7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761\": container with ID starting with 7d9c72ccde9547d7bf06ab1a86bd0477842b6bc9b03655455cc40e78ae8dc761 not found: ID does not exist" Jul 06 18:52:58.083140 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.083110 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") pod \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " Jul 06 18:52:58.083300 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.083209 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca\") pod \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " Jul 06 18:52:58.083300 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.083241 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2jhh\" (UniqueName: \"kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh\") pod \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\" (UID: \"46c829a8-f25d-40c4-a7db-a83b8240cfaa\") " Jul 06 18:52:58.083661 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.083635 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46c829a8-f25d-40c4-a7db-a83b8240cfaa" (UID: "46c829a8-f25d-40c4-a7db-a83b8240cfaa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:52:58.085373 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.085348 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46c829a8-f25d-40c4-a7db-a83b8240cfaa" (UID: "46c829a8-f25d-40c4-a7db-a83b8240cfaa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:52:58.085488 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.085387 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh" (OuterVolumeSpecName: "kube-api-access-j2jhh") pod "46c829a8-f25d-40c4-a7db-a83b8240cfaa" (UID: "46c829a8-f25d-40c4-a7db-a83b8240cfaa"). InnerVolumeSpecName "kube-api-access-j2jhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:52:58.184221 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.184180 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c829a8-f25d-40c4-a7db-a83b8240cfaa-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:52:58.184221 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.184214 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2jhh\" (UniqueName: \"kubernetes.io/projected/46c829a8-f25d-40c4-a7db-a83b8240cfaa-kube-api-access-j2jhh\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:52:58.184221 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.184226 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c829a8-f25d-40c4-a7db-a83b8240cfaa-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:52:58.386328 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.386126 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:52:58.388860 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:58.388833 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f2348c-5dbb4bf5c7-8psrq"] Jul 06 18:52:59.318251 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:52:59.318212 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" path="/var/lib/kubelet/pods/46c829a8-f25d-40c4-a7db-a83b8240cfaa/volumes" Jul 06 18:53:41.234938 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.234902 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:53:41.235561 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.235145 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" podUID="5b801d7a-82ff-44a2-b964-9dafaba11a24" containerName="maas-api" containerID="cri-o://799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60" gracePeriod=30 Jul 06 18:53:41.491485 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.491421 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:53:41.590014 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.589965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls\") pod \"5b801d7a-82ff-44a2-b964-9dafaba11a24\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " Jul 06 18:53:41.590212 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.590037 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcbk2\" (UniqueName: \"kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2\") pod \"5b801d7a-82ff-44a2-b964-9dafaba11a24\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " Jul 06 18:53:41.590212 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.590070 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca\") pod \"5b801d7a-82ff-44a2-b964-9dafaba11a24\" (UID: \"5b801d7a-82ff-44a2-b964-9dafaba11a24\") " Jul 06 18:53:41.590502 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.590473 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b801d7a-82ff-44a2-b964-9dafaba11a24" (UID: "5b801d7a-82ff-44a2-b964-9dafaba11a24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:53:41.592025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.592004 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2" (OuterVolumeSpecName: "kube-api-access-pcbk2") pod "5b801d7a-82ff-44a2-b964-9dafaba11a24" (UID: "5b801d7a-82ff-44a2-b964-9dafaba11a24"). InnerVolumeSpecName "kube-api-access-pcbk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:53:41.592117 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.592097 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b801d7a-82ff-44a2-b964-9dafaba11a24" (UID: "5b801d7a-82ff-44a2-b964-9dafaba11a24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:53:41.691218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.691174 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b801d7a-82ff-44a2-b964-9dafaba11a24-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:53:41.691218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.691207 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcbk2\" (UniqueName: \"kubernetes.io/projected/5b801d7a-82ff-44a2-b964-9dafaba11a24-kube-api-access-pcbk2\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:53:41.691218 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:41.691222 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b801d7a-82ff-44a2-b964-9dafaba11a24-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:53:42.269540 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.269505 2574 generic.go:356] "Generic (PLEG): container finished" podID="5b801d7a-82ff-44a2-b964-9dafaba11a24" containerID="799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60" exitCode=0 Jul 06 18:53:42.270068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.269567 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" Jul 06 18:53:42.270068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.269594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" event={"ID":"5b801d7a-82ff-44a2-b964-9dafaba11a24","Type":"ContainerDied","Data":"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60"} Jul 06 18:53:42.270068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.269650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv" event={"ID":"5b801d7a-82ff-44a2-b964-9dafaba11a24","Type":"ContainerDied","Data":"488ef8117b345bb8c36a4095ddc431760385fb222e8d9b48030bf78496270e6c"} Jul 06 18:53:42.270068 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.269671 2574 scope.go:117] "RemoveContainer" containerID="799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60" Jul 06 18:53:42.278550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.278531 2574 scope.go:117] "RemoveContainer" containerID="799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60" Jul 06 18:53:42.278830 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:53:42.278811 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60\": container with ID starting with 799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60 not found: ID does not exist" containerID="799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60" Jul 06 18:53:42.278888 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.278840 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60"} err="failed to get container status \"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60\": rpc error: code = NotFound desc = could not find container \"799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60\": container with ID starting with 799d0afb37add97b8627c0f510e071f9acc93d0fe2f0fb338b84534f43c93c60 not found: ID does not exist" Jul 06 18:53:42.292537 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.292509 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:53:42.295432 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:42.295407 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-ef5ef7-74dbf46b7b-j8tqv"] Jul 06 18:53:43.312560 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:43.312528 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b801d7a-82ff-44a2-b964-9dafaba11a24" path="/var/lib/kubelet/pods/5b801d7a-82ff-44a2-b964-9dafaba11a24/volumes" Jul 06 18:53:52.601398 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.601302 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:53:52.601925 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.601905 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" containerName="maas-api" Jul 06 18:53:52.601999 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.601928 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" containerName="maas-api" Jul 06 18:53:52.601999 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.601973 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b801d7a-82ff-44a2-b964-9dafaba11a24" containerName="maas-api" Jul 06 18:53:52.601999 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.601982 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b801d7a-82ff-44a2-b964-9dafaba11a24" containerName="maas-api" Jul 06 18:53:52.602161 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.602079 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c829a8-f25d-40c4-a7db-a83b8240cfaa" containerName="maas-api" Jul 06 18:53:52.602161 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.602090 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b801d7a-82ff-44a2-b964-9dafaba11a24" containerName="maas-api" Jul 06 18:53:52.606531 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.606501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.611133 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.611110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-f58a8f-serving-cert\"" Jul 06 18:53:52.615710 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.615686 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:53:52.687880 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.687827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.688100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.687946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvwd\" (UniqueName: \"kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.688100 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.687993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.789204 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.789158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.789428 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.789227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvwd\" (UniqueName: \"kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.789428 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.789259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.789428 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:53:52.789336 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-f58a8f-serving-cert: secret "maas-api-e2e-api-a-f58a8f-serving-cert" not found Jul 06 18:53:52.789428 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:53:52.789422 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls podName:a7887e6f-2dd2-45b5-9642-fc2fe7b4993f nodeName:}" failed. No retries permitted until 2026-07-06 18:53:53.28940228 +0000 UTC m=+2067.367478211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls") pod "maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" (UID: "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f") : secret "maas-api-e2e-api-a-f58a8f-serving-cert" not found Jul 06 18:53:52.790049 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.790024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:52.802021 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:52.801990 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvwd\" (UniqueName: \"kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:53.294503 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:53.294464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:53.297108 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:53.297079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") pod \"maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:53.519286 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:53.519245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:53.674363 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:53.674335 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:53:53.676571 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:53:53.676544 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7887e6f_2dd2_45b5_9642_fc2fe7b4993f.slice/crio-d5b630e6c1732d5f3e9f93b07c848f6cc76bfa118367ad96fc690ca567781e86 WatchSource:0}: Error finding container d5b630e6c1732d5f3e9f93b07c848f6cc76bfa118367ad96fc690ca567781e86: Status 404 returned error can't find the container with id d5b630e6c1732d5f3e9f93b07c848f6cc76bfa118367ad96fc690ca567781e86 Jul 06 18:53:54.328002 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:54.327968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" event={"ID":"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f","Type":"ContainerStarted","Data":"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426"} Jul 06 18:53:54.328207 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:54.328029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" event={"ID":"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f","Type":"ContainerStarted","Data":"d5b630e6c1732d5f3e9f93b07c848f6cc76bfa118367ad96fc690ca567781e86"} Jul 06 18:53:54.328349 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:54.328322 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:53:54.351668 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:53:54.351611 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" podStartSLOduration=1.878054492 podStartE2EDuration="2.351594925s" totalImagesPullingTime="473.540433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:53:54.350188346 +0000 UTC m=+2068.428264305" watchObservedRunningTime="2026-07-06 18:53:54.351594925 +0000 UTC m=+2068.429670861" Jul 06 18:54:00.339444 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.339417 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:54:00.690710 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.690673 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:00.694310 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.694282 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.700828 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.700775 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-47576a-serving-cert\"" Jul 06 18:54:00.708624 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.708598 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:00.768145 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.768104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshbk\" (UniqueName: \"kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.768362 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.768193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.768362 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.768245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.869341 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.869307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nshbk\" (UniqueName: \"kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.869550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.869384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.869550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.869439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.870175 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.870156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.871901 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.871879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:00.883767 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:00.883744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshbk\" (UniqueName: \"kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk\") pod \"maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:01.007237 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:01.007138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:01.160868 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:01.160844 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:01.163740 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:54:01.163715 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3867779b_1543_49e3_9100_94ad3a6d7b64.slice/crio-355d74fc7df268fdcb0df4397da2853d21b8df88ca76dde9477574825840c6ea WatchSource:0}: Error finding container 355d74fc7df268fdcb0df4397da2853d21b8df88ca76dde9477574825840c6ea: Status 404 returned error can't find the container with id 355d74fc7df268fdcb0df4397da2853d21b8df88ca76dde9477574825840c6ea Jul 06 18:54:01.362979 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:01.362887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" event={"ID":"3867779b-1543-49e3-9100-94ad3a6d7b64","Type":"ContainerStarted","Data":"355d74fc7df268fdcb0df4397da2853d21b8df88ca76dde9477574825840c6ea"} Jul 06 18:54:02.370012 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:02.369967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" event={"ID":"3867779b-1543-49e3-9100-94ad3a6d7b64","Type":"ContainerStarted","Data":"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9"} Jul 06 18:54:02.370505 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:02.370100 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:02.392820 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:02.392752 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" podStartSLOduration=1.864228231 podStartE2EDuration="2.392737612s" totalImagesPullingTime="528.509381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:54:02.390651433 +0000 UTC m=+2076.468727370" watchObservedRunningTime="2026-07-06 18:54:02.392737612 +0000 UTC m=+2076.470813548" Jul 06 18:54:08.381174 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:08.381148 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:14.156887 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.156843 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:54:14.157448 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.157051 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" podUID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" containerName="maas-api" containerID="cri-o://c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426" gracePeriod=30 Jul 06 18:54:14.403348 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.403317 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:54:14.436733 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.436641 2574 generic.go:356] "Generic (PLEG): container finished" podID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" containerID="c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426" exitCode=0 Jul 06 18:54:14.436733 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.436685 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" Jul 06 18:54:14.436733 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.436723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" event={"ID":"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f","Type":"ContainerDied","Data":"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426"} Jul 06 18:54:14.437064 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.436782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq" event={"ID":"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f","Type":"ContainerDied","Data":"d5b630e6c1732d5f3e9f93b07c848f6cc76bfa118367ad96fc690ca567781e86"} Jul 06 18:54:14.437064 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.436808 2574 scope.go:117] "RemoveContainer" containerID="c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426" Jul 06 18:54:14.445429 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.445408 2574 scope.go:117] "RemoveContainer" containerID="c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426" Jul 06 18:54:14.445767 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:54:14.445748 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426\": container with ID starting with c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426 not found: ID does not exist" containerID="c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426" Jul 06 18:54:14.445912 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.445778 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426"} err="failed to get container status \"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426\": rpc error: code = NotFound desc = could not find container \"c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426\": container with ID starting with c8d224c870a21b2eddbce85f3629c98be9a78fc954927f00ec3efddc44d00426 not found: ID does not exist" Jul 06 18:54:14.502083 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.502041 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca\") pod \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " Jul 06 18:54:14.502264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.502116 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") pod \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " Jul 06 18:54:14.502264 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.502172 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dvwd\" (UniqueName: \"kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd\") pod \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\" (UID: \"a7887e6f-2dd2-45b5-9642-fc2fe7b4993f\") " Jul 06 18:54:14.502432 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.502410 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" (UID: "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:54:14.504291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.504264 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd" (OuterVolumeSpecName: "kube-api-access-9dvwd") pod "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" (UID: "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f"). InnerVolumeSpecName "kube-api-access-9dvwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:54:14.504291 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.504264 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" (UID: "a7887e6f-2dd2-45b5-9642-fc2fe7b4993f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:54:14.602942 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.602906 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:14.602942 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.602936 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dvwd\" (UniqueName: \"kubernetes.io/projected/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-kube-api-access-9dvwd\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:14.602942 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.602948 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:14.763054 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.763016 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:54:14.774084 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:14.774055 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f58a8f-586d55fc7b-96fmq"] Jul 06 18:54:15.313196 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:15.313160 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" path="/var/lib/kubelet/pods/a7887e6f-2dd2-45b5-9642-fc2fe7b4993f/volumes" Jul 06 18:54:21.002354 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.002319 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:21.002770 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.002548 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" podUID="3867779b-1543-49e3-9100-94ad3a6d7b64" containerName="maas-api" containerID="cri-o://83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9" gracePeriod=30 Jul 06 18:54:21.256327 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.256253 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:21.265845 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.265811 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls\") pod \"3867779b-1543-49e3-9100-94ad3a6d7b64\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " Jul 06 18:54:21.265845 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.265848 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca\") pod \"3867779b-1543-49e3-9100-94ad3a6d7b64\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " Jul 06 18:54:21.266044 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.265902 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nshbk\" (UniqueName: \"kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk\") pod \"3867779b-1543-49e3-9100-94ad3a6d7b64\" (UID: \"3867779b-1543-49e3-9100-94ad3a6d7b64\") " Jul 06 18:54:21.266268 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.266242 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3867779b-1543-49e3-9100-94ad3a6d7b64" (UID: "3867779b-1543-49e3-9100-94ad3a6d7b64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:54:21.268053 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.268026 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk" (OuterVolumeSpecName: "kube-api-access-nshbk") pod "3867779b-1543-49e3-9100-94ad3a6d7b64" (UID: "3867779b-1543-49e3-9100-94ad3a6d7b64"). InnerVolumeSpecName "kube-api-access-nshbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:54:21.268178 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.268118 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3867779b-1543-49e3-9100-94ad3a6d7b64" (UID: "3867779b-1543-49e3-9100-94ad3a6d7b64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:54:21.366644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.366601 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nshbk\" (UniqueName: \"kubernetes.io/projected/3867779b-1543-49e3-9100-94ad3a6d7b64-kube-api-access-nshbk\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:21.366644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.366645 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3867779b-1543-49e3-9100-94ad3a6d7b64-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:21.366954 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.366661 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3867779b-1543-49e3-9100-94ad3a6d7b64-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 18:54:21.474370 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.474332 2574 generic.go:356] "Generic (PLEG): container finished" podID="3867779b-1543-49e3-9100-94ad3a6d7b64" containerID="83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9" exitCode=0 Jul 06 18:54:21.474370 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.474373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" event={"ID":"3867779b-1543-49e3-9100-94ad3a6d7b64","Type":"ContainerDied","Data":"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9"} Jul 06 18:54:21.474578 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.474401 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" Jul 06 18:54:21.474578 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.474439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f" event={"ID":"3867779b-1543-49e3-9100-94ad3a6d7b64","Type":"ContainerDied","Data":"355d74fc7df268fdcb0df4397da2853d21b8df88ca76dde9477574825840c6ea"} Jul 06 18:54:21.474578 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.474461 2574 scope.go:117] "RemoveContainer" containerID="83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9" Jul 06 18:54:21.483256 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.483239 2574 scope.go:117] "RemoveContainer" containerID="83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9" Jul 06 18:54:21.483537 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:54:21.483515 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9\": container with ID starting with 83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9 not found: ID does not exist" containerID="83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9" Jul 06 18:54:21.483644 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.483542 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9"} err="failed to get container status \"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9\": rpc error: code = NotFound desc = could not find container \"83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9\": container with ID starting with 83e65e9bc8fd4bc5da7472294066d5154b11c92c7834012437db73c50bbba7f9 not found: ID does not exist" Jul 06 18:54:21.491127 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.491100 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:21.495102 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:21.495077 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47576a-7bc7fb4b45-ckf4f"] Jul 06 18:54:23.313176 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:23.313142 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3867779b-1543-49e3-9100-94ad3a6d7b64" path="/var/lib/kubelet/pods/3867779b-1543-49e3-9100-94ad3a6d7b64/volumes" Jul 06 18:54:27.373837 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:27.373810 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:54:27.375528 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:27.375505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:54:30.832129 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832098 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 18:54:30.832546 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832524 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" containerName="maas-api" Jul 06 18:54:30.832546 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832544 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" containerName="maas-api" Jul 06 18:54:30.832635 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832568 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3867779b-1543-49e3-9100-94ad3a6d7b64" containerName="maas-api" Jul 06 18:54:30.832635 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832581 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3867779b-1543-49e3-9100-94ad3a6d7b64" containerName="maas-api" Jul 06 18:54:30.832709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832665 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3867779b-1543-49e3-9100-94ad3a6d7b64" containerName="maas-api" Jul 06 18:54:30.832709 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.832676 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7887e6f-2dd2-45b5-9642-fc2fe7b4993f" containerName="maas-api" Jul 06 18:54:30.835702 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.835686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:30.839027 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.839003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-47f1eb-serving-cert\"" Jul 06 18:54:30.848434 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.848406 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 18:54:30.951344 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.951301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxxq7\" (UniqueName: \"kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:30.951344 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.951351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:30.951588 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:30.951419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.051996 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.051959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxxq7\" (UniqueName: \"kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.051996 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.052002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.052185 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.052053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.052185 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:54:31.052160 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-47f1eb-serving-cert: secret "maas-api-e2e-shared-a-47f1eb-serving-cert" not found Jul 06 18:54:31.052302 ip-10-0-132-134 kubenswrapper[2574]: E0706 18:54:31.052227 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls podName:d54f06ca-d60b-45e5-b030-b04acfd8473d nodeName:}" failed. No retries permitted until 2026-07-06 18:54:31.552207427 +0000 UTC m=+2105.630283348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls") pod "maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" (UID: "d54f06ca-d60b-45e5-b030-b04acfd8473d") : secret "maas-api-e2e-shared-a-47f1eb-serving-cert" not found Jul 06 18:54:31.052638 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.052618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.062581 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.062548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxxq7\" (UniqueName: \"kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.557085 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.557045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.559559 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.559539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") pod \"maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.747699 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.747663 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:31.896320 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:31.896239 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 18:54:31.899373 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:54:31.899343 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54f06ca_d60b_45e5_b030_b04acfd8473d.slice/crio-8badfa2d875d17f117ea0f46920e21161262effafc531efe2080bf3597d38aba WatchSource:0}: Error finding container 8badfa2d875d17f117ea0f46920e21161262effafc531efe2080bf3597d38aba: Status 404 returned error can't find the container with id 8badfa2d875d17f117ea0f46920e21161262effafc531efe2080bf3597d38aba Jul 06 18:54:32.528583 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:32.528544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" event={"ID":"d54f06ca-d60b-45e5-b030-b04acfd8473d","Type":"ContainerStarted","Data":"1a0c24ae8d7b88f5d43c6571ee84813457f7cca5b02c25cbbfb7d7ac8c655173"} Jul 06 18:54:32.528758 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:32.528606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" event={"ID":"d54f06ca-d60b-45e5-b030-b04acfd8473d","Type":"ContainerStarted","Data":"8badfa2d875d17f117ea0f46920e21161262effafc531efe2080bf3597d38aba"} Jul 06 18:54:32.528758 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:32.528719 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:32.558328 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:32.558276 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" podStartSLOduration=2.137943076 podStartE2EDuration="2.558261516s" totalImagesPullingTime="420.31844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:54:32.556725379 +0000 UTC m=+2106.634801315" watchObservedRunningTime="2026-07-06 18:54:32.558261516 +0000 UTC m=+2106.636337451" Jul 06 18:54:38.539167 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:38.539136 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 18:54:39.142386 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.142352 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 18:54:39.146065 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.146045 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.149051 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.149028 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-b19850-serving-cert\"" Jul 06 18:54:39.172025 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.171986 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 18:54:39.232384 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.232345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc2zf\" (UniqueName: \"kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.232564 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.232400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.232564 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.232514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.333550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.333511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc2zf\" (UniqueName: \"kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.333550 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.333559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.333778 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.333606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.334248 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.334226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.336144 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.336122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.342167 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.342139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc2zf\" (UniqueName: \"kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf\") pod \"maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.456440 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.456343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:39.603705 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:39.603652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 18:54:39.606277 ip-10-0-132-134 kubenswrapper[2574]: W0706 18:54:39.606235 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed1b5eb_0d72_49a0_af24_678395744c23.slice/crio-40af64e9c92e2dbd421b2b47df7f7bff76e56accf58bec2445b1d14555108edf WatchSource:0}: Error finding container 40af64e9c92e2dbd421b2b47df7f7bff76e56accf58bec2445b1d14555108edf: Status 404 returned error can't find the container with id 40af64e9c92e2dbd421b2b47df7f7bff76e56accf58bec2445b1d14555108edf Jul 06 18:54:40.569282 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:40.569244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" event={"ID":"1ed1b5eb-0d72-49a0-af24-678395744c23","Type":"ContainerStarted","Data":"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458"} Jul 06 18:54:40.569452 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:40.569443 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:54:40.569494 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:40.569469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" event={"ID":"1ed1b5eb-0d72-49a0-af24-678395744c23","Type":"ContainerStarted","Data":"40af64e9c92e2dbd421b2b47df7f7bff76e56accf58bec2445b1d14555108edf"} Jul 06 18:54:40.606148 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:40.606093 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" podStartSLOduration=1.27767545 podStartE2EDuration="1.60607701s" totalImagesPullingTime="328.40156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:54:40.605373627 +0000 UTC m=+2114.683449564" watchObservedRunningTime="2026-07-06 18:54:40.60607701 +0000 UTC m=+2114.684152946" Jul 06 18:54:46.579840 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:54:46.579807 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 18:59:27.402675 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:59:27.402632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 18:59:27.405690 ip-10-0-132-134 kubenswrapper[2574]: I0706 18:59:27.405667 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 19:01:48.525880 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.525839 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 19:01:48.526339 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.526075 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerName="maas-api" containerID="cri-o://1a0c24ae8d7b88f5d43c6571ee84813457f7cca5b02c25cbbfb7d7ac8c655173" gracePeriod=30 Jul 06 19:01:48.534300 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.534265 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.49:8443/health\": dial tcp 10.133.0.49:8443: connect: connection refused" Jul 06 19:01:48.667607 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.667572 2574 generic.go:356] "Generic (PLEG): container finished" podID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerID="1a0c24ae8d7b88f5d43c6571ee84813457f7cca5b02c25cbbfb7d7ac8c655173" exitCode=0 Jul 06 19:01:48.667774 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.667631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" event={"ID":"d54f06ca-d60b-45e5-b030-b04acfd8473d","Type":"ContainerDied","Data":"1a0c24ae8d7b88f5d43c6571ee84813457f7cca5b02c25cbbfb7d7ac8c655173"} Jul 06 19:01:48.781240 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.781175 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 19:01:48.951861 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.951822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") pod \"d54f06ca-d60b-45e5-b030-b04acfd8473d\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " Jul 06 19:01:48.952049 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.951968 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxxq7\" (UniqueName: \"kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7\") pod \"d54f06ca-d60b-45e5-b030-b04acfd8473d\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " Jul 06 19:01:48.952049 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.951994 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca\") pod \"d54f06ca-d60b-45e5-b030-b04acfd8473d\" (UID: \"d54f06ca-d60b-45e5-b030-b04acfd8473d\") " Jul 06 19:01:48.952410 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.952387 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d54f06ca-d60b-45e5-b030-b04acfd8473d" (UID: "d54f06ca-d60b-45e5-b030-b04acfd8473d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:01:48.954088 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.954062 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d54f06ca-d60b-45e5-b030-b04acfd8473d" (UID: "d54f06ca-d60b-45e5-b030-b04acfd8473d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:01:48.954200 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:48.954086 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7" (OuterVolumeSpecName: "kube-api-access-gxxq7") pod "d54f06ca-d60b-45e5-b030-b04acfd8473d" (UID: "d54f06ca-d60b-45e5-b030-b04acfd8473d"). InnerVolumeSpecName "kube-api-access-gxxq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:01:49.053322 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.053222 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d54f06ca-d60b-45e5-b030-b04acfd8473d-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:49.053322 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.053255 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxxq7\" (UniqueName: \"kubernetes.io/projected/d54f06ca-d60b-45e5-b030-b04acfd8473d-kube-api-access-gxxq7\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:49.053322 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.053266 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54f06ca-d60b-45e5-b030-b04acfd8473d-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:49.674231 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.674204 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" Jul 06 19:01:49.674670 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.674203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8" event={"ID":"d54f06ca-d60b-45e5-b030-b04acfd8473d","Type":"ContainerDied","Data":"8badfa2d875d17f117ea0f46920e21161262effafc531efe2080bf3597d38aba"} Jul 06 19:01:49.674670 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.674341 2574 scope.go:117] "RemoveContainer" containerID="1a0c24ae8d7b88f5d43c6571ee84813457f7cca5b02c25cbbfb7d7ac8c655173" Jul 06 19:01:49.708359 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.708315 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 19:01:49.715059 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:49.715030 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-47f1eb-867d4cd686-gjsf8"] Jul 06 19:01:51.319923 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:51.319884 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" path="/var/lib/kubelet/pods/d54f06ca-d60b-45e5-b030-b04acfd8473d/volumes" Jul 06 19:01:57.417078 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.417042 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 19:01:57.417590 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.417354 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" podUID="1ed1b5eb-0d72-49a0-af24-678395744c23" containerName="maas-api" containerID="cri-o://8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458" gracePeriod=30 Jul 06 19:01:57.671260 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.671192 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 19:01:57.714235 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.714198 2574 generic.go:356] "Generic (PLEG): container finished" podID="1ed1b5eb-0d72-49a0-af24-678395744c23" containerID="8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458" exitCode=0 Jul 06 19:01:57.714433 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.714250 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" Jul 06 19:01:57.714433 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.714250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" event={"ID":"1ed1b5eb-0d72-49a0-af24-678395744c23","Type":"ContainerDied","Data":"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458"} Jul 06 19:01:57.714433 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.714385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w" event={"ID":"1ed1b5eb-0d72-49a0-af24-678395744c23","Type":"ContainerDied","Data":"40af64e9c92e2dbd421b2b47df7f7bff76e56accf58bec2445b1d14555108edf"} Jul 06 19:01:57.714433 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.714416 2574 scope.go:117] "RemoveContainer" containerID="8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458" Jul 06 19:01:57.723947 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.723924 2574 scope.go:117] "RemoveContainer" containerID="8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458" Jul 06 19:01:57.724266 ip-10-0-132-134 kubenswrapper[2574]: E0706 19:01:57.724244 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458\": container with ID starting with 8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458 not found: ID does not exist" containerID="8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458" Jul 06 19:01:57.724367 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.724271 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458"} err="failed to get container status \"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458\": rpc error: code = NotFound desc = could not find container \"8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458\": container with ID starting with 8d25ae7569d200428b3ec65638c3fa7393213ad925cf7cc7a562bab6b764b458 not found: ID does not exist" Jul 06 19:01:57.728633 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.728612 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc2zf\" (UniqueName: \"kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf\") pod \"1ed1b5eb-0d72-49a0-af24-678395744c23\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " Jul 06 19:01:57.728737 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.728640 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls\") pod \"1ed1b5eb-0d72-49a0-af24-678395744c23\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " Jul 06 19:01:57.728737 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.728685 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca\") pod \"1ed1b5eb-0d72-49a0-af24-678395744c23\" (UID: \"1ed1b5eb-0d72-49a0-af24-678395744c23\") " Jul 06 19:01:57.729208 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.729180 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ed1b5eb-0d72-49a0-af24-678395744c23" (UID: "1ed1b5eb-0d72-49a0-af24-678395744c23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:01:57.730827 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.730803 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ed1b5eb-0d72-49a0-af24-678395744c23" (UID: "1ed1b5eb-0d72-49a0-af24-678395744c23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:01:57.730827 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.730808 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf" (OuterVolumeSpecName: "kube-api-access-kc2zf") pod "1ed1b5eb-0d72-49a0-af24-678395744c23" (UID: "1ed1b5eb-0d72-49a0-af24-678395744c23"). InnerVolumeSpecName "kube-api-access-kc2zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:01:57.829633 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.829597 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc2zf\" (UniqueName: \"kubernetes.io/projected/1ed1b5eb-0d72-49a0-af24-678395744c23-kube-api-access-kc2zf\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:57.829633 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.829627 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed1b5eb-0d72-49a0-af24-678395744c23-maas-api-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:57.829633 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:57.829636 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed1b5eb-0d72-49a0-af24-678395744c23-openshift-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 06 19:01:58.055298 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:58.055263 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 19:01:58.067569 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:58.067535 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b19850-784c8b6f85-54f7w"] Jul 06 19:01:59.312843 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:01:59.312812 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed1b5eb-0d72-49a0-af24-678395744c23" path="/var/lib/kubelet/pods/1ed1b5eb-0d72-49a0-af24-678395744c23/volumes" Jul 06 19:02:11.128268 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:11.128237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7d886d7d97-7jc9x_af86fd22-41b9-4691-b741-46d813955a5c/maas-api/0.log" Jul 06 19:02:11.655337 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:11.655302 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdf75475b-t8nlc_fba1e27e-32f9-4847-9b32-268e9de8e3bc/manager/0.log" Jul 06 19:02:12.220894 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:12.220869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf95b557-bhfr4_a34fd8b1-56e1-4264-99ad-ad6a4a94022e/copy-manifests/0.log" Jul 06 19:02:12.234612 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:12.234586 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf95b557-bhfr4_a34fd8b1-56e1-4264-99ad-ad6a4a94022e/manager/0.log" Jul 06 19:02:14.319588 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:14.319560 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pt8dr_8a292301-d4bf-46ad-94a9-4f3739ee3d0c/kuadrant-console-plugin/0.log" Jul 06 19:02:14.852149 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:14.852107 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gzmj_50dc14de-b06d-424a-a9fa-79a6963fd85c/manager/0.log" Jul 06 19:02:15.464736 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:15.464707 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-88568c598-lw9qn_cadbbd5a-c465-4e24-8911-beb3e216cdff/kube-auth-proxy/0.log" Jul 06 19:02:15.841953 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:15.841869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-gq4nr_18462f9b-edd0-4c24-9812-69d8ae2a4557/payload-pre-processing/0.log" Jul 06 19:02:16.101367 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:16.101286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f6df67dcf-4vpzr_3d9bd0df-c5ad-4e06-af60-5810eacd4801/router/0.log" Jul 06 19:02:16.576003 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:16.575975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dxskp_8ee73838-daec-4d41-a210-e68a96da5a11/main/0.log" Jul 06 19:02:16.812596 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:16.812560 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db98fhm_f073019b-bf47-4fe0-8c63-046d1ceaa210/main/0.log" Jul 06 19:02:17.060324 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:17.060286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-b267w_03f7816e-537d-437f-9394-f7517269d5bd/main/0.log" Jul 06 19:02:25.119624 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:25.119593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s8mnz_cf1ead76-3dde-431e-b231-34ffcc6e7578/global-pull-secret-syncer/0.log" Jul 06 19:02:25.276209 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:25.276177 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jr9zj_a26d69c9-3ed0-4d2b-889d-3637029900d5/konnectivity-agent/0.log" Jul 06 19:02:25.416617 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:25.416584 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-134.ec2.internal_d9c1950d01285c941f9419cd08660742/haproxy/0.log" Jul 06 19:02:30.815775 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:30.815745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pt8dr_8a292301-d4bf-46ad-94a9-4f3739ee3d0c/kuadrant-console-plugin/0.log" Jul 06 19:02:31.226445 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:31.226412 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gzmj_50dc14de-b06d-424a-a9fa-79a6963fd85c/manager/0.log" Jul 06 19:02:33.482767 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:33.482735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-nqxrg_d5b86957-9567-47c7-89b5-d8bbe146942e/cluster-monitoring-operator/0.log" Jul 06 19:02:34.073057 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.073033 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pw2zb_5aa39338-8d5d-48df-be18-44d4652d8485/node-exporter/0.log" Jul 06 19:02:34.104018 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.103992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pw2zb_5aa39338-8d5d-48df-be18-44d4652d8485/kube-rbac-proxy/0.log" Jul 06 19:02:34.133635 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.133608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pw2zb_5aa39338-8d5d-48df-be18-44d4652d8485/init-textfile/0.log" Jul 06 19:02:34.298411 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.298380 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/prometheus/0.log" Jul 06 19:02:34.330823 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.330722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/config-reloader/0.log" Jul 06 19:02:34.372578 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.372551 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/thanos-sidecar/0.log" Jul 06 19:02:34.400023 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.400000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/kube-rbac-proxy-web/0.log" Jul 06 19:02:34.426186 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.426158 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/kube-rbac-proxy/0.log" Jul 06 19:02:34.451857 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.451830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/kube-rbac-proxy-thanos/0.log" Jul 06 19:02:34.478604 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.478578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48655ee-aaf1-43ac-89ea-06c99497b1c2/init-config-reloader/0.log" Jul 06 19:02:34.592263 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.592167 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fdd57889-k8wdr_3c9616ca-34cb-445d-8d68-95beec66ec51/telemeter-client/0.log" Jul 06 19:02:34.616106 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.616082 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fdd57889-k8wdr_3c9616ca-34cb-445d-8d68-95beec66ec51/reload/0.log" Jul 06 19:02:34.640566 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:34.640539 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fdd57889-k8wdr_3c9616ca-34cb-445d-8d68-95beec66ec51/kube-rbac-proxy/0.log" Jul 06 19:02:35.249099 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249060 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh"] Jul 06 19:02:35.249469 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249456 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerName="maas-api" Jul 06 19:02:35.249469 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249470 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerName="maas-api" Jul 06 19:02:35.249601 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249493 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed1b5eb-0d72-49a0-af24-678395744c23" containerName="maas-api" Jul 06 19:02:35.249601 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249498 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed1b5eb-0d72-49a0-af24-678395744c23" containerName="maas-api" Jul 06 19:02:35.249601 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249549 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed1b5eb-0d72-49a0-af24-678395744c23" containerName="maas-api" Jul 06 19:02:35.249601 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.249558 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54f06ca-d60b-45e5-b030-b04acfd8473d" containerName="maas-api" Jul 06 19:02:35.252674 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.252653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.270020 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.269994 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cgk74\"/\"default-dockercfg-tpbrd\"" Jul 06 19:02:35.270703 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.270690 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cgk74\"/\"kube-root-ca.crt\"" Jul 06 19:02:35.270756 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.270723 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cgk74\"/\"openshift-service-ca.crt\"" Jul 06 19:02:35.278384 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.278358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh"] Jul 06 19:02:35.381062 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.381022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-lib-modules\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.381254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.381069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vhf\" (UniqueName: \"kubernetes.io/projected/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-kube-api-access-75vhf\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.381254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.381150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-sys\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.381254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.381172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-podres\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.381254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.381187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-proc\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482061 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-lib-modules\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vhf\" (UniqueName: \"kubernetes.io/projected/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-kube-api-access-75vhf\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-sys\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-podres\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-proc\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482254 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-lib-modules\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482507 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-sys\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482507 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-proc\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.482507 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.482343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-podres\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.491459 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.491425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vhf\" (UniqueName: \"kubernetes.io/projected/5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53-kube-api-access-75vhf\") pod \"perf-node-gather-daemonset-jszlh\" (UID: \"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53\") " pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.563194 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.563084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.705509 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.705475 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh"] Jul 06 19:02:35.708986 ip-10-0-132-134 kubenswrapper[2574]: W0706 19:02:35.708957 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a9c4a37_fd74_4b7a_b765_ffd7d74b7e53.slice/crio-e2ba22fd95de86ba5d520c942badd8762a99b8939c6f24b6e7ea2df08579b0ea WatchSource:0}: Error finding container e2ba22fd95de86ba5d520c942badd8762a99b8939c6f24b6e7ea2df08579b0ea: Status 404 returned error can't find the container with id e2ba22fd95de86ba5d520c942badd8762a99b8939c6f24b6e7ea2df08579b0ea Jul 06 19:02:35.908285 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.908250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" event={"ID":"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53","Type":"ContainerStarted","Data":"80ef74ce345c82e8160f61a8e516c6e582d1f84280db51bddc50a85acae505cf"} Jul 06 19:02:35.908479 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.908310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" event={"ID":"5a9c4a37-fd74-4b7a-b765-ffd7d74b7e53","Type":"ContainerStarted","Data":"e2ba22fd95de86ba5d520c942badd8762a99b8939c6f24b6e7ea2df08579b0ea"} Jul 06 19:02:35.908479 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.908344 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:35.931347 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:35.931294 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" podStartSLOduration=0.931276935 podStartE2EDuration="931.276935ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:02:35.928720117 +0000 UTC m=+2590.006796076" watchObservedRunningTime="2026-07-06 19:02:35.931276935 +0000 UTC m=+2590.009352890" Jul 06 19:02:36.039175 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:36.039146 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-cgj92_11cf91b7-382e-4b5e-ba7a-2c77bb189225/networking-console-plugin/0.log" Jul 06 19:02:36.648638 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:36.648608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/1.log" Jul 06 19:02:36.652552 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:36.652534 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-54qvj_5e45e6e1-bb7b-407f-a75a-697c16d3f155/console-operator/2.log" Jul 06 19:02:37.317044 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:37.317017 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-j9cqz_bffb6cc0-5be9-4bf9-a42d-4a6c8f8e33c2/download-server/0.log" Jul 06 19:02:37.938962 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:37.938931 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fzkb5_4368953e-2c4f-4f8f-acbe-dfa035dbbb8d/volume-data-source-validator/0.log" Jul 06 19:02:39.052716 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:39.052683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwp97_352c0f19-8001-4609-a035-dfa6a9870099/dns/0.log" Jul 06 19:02:39.084769 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:39.084738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwp97_352c0f19-8001-4609-a035-dfa6a9870099/kube-rbac-proxy/0.log" Jul 06 19:02:39.270180 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:39.270147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvxk2_98dde2d6-8c6b-47b6-836a-77fdcc21cec6/dns-node-resolver/0.log" Jul 06 19:02:40.052126 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:40.052080 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8k9w4_a4b39dbf-4482-4fc9-9e6e-48bea8305aa2/node-ca/0.log" Jul 06 19:02:41.429840 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:41.429806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-88568c598-lw9qn_cadbbd5a-c465-4e24-8911-beb3e216cdff/kube-auth-proxy/0.log" Jul 06 19:02:41.569092 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:41.569061 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-gq4nr_18462f9b-edd0-4c24-9812-69d8ae2a4557/payload-pre-processing/0.log" Jul 06 19:02:41.699888 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:41.699811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f6df67dcf-4vpzr_3d9bd0df-c5ad-4e06-af60-5810eacd4801/router/0.log" Jul 06 19:02:41.923520 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:41.923495 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cgk74/perf-node-gather-daemonset-jszlh" Jul 06 19:02:42.497928 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:42.497898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95jw2_6c5f36f3-6e1e-4c18-8031-8fde16839bf7/serve-healthcheck-canary/0.log" Jul 06 19:02:43.027051 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:43.027016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-cjms7_e504b025-c2f2-4e9f-83d6-cc17e9f67a3e/insights-operator/0.log" Jul 06 19:02:43.027475 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:43.027456 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-cjms7_e504b025-c2f2-4e9f-83d6-cc17e9f67a3e/insights-operator/1.log" Jul 06 19:02:43.314080 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:43.314000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkkcw_f29bd5a6-e0c4-453c-89af-a46e8a04b2bb/kube-rbac-proxy/0.log" Jul 06 19:02:43.354267 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:43.354234 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkkcw_f29bd5a6-e0c4-453c-89af-a46e8a04b2bb/exporter/0.log" Jul 06 19:02:43.454157 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:43.454118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkkcw_f29bd5a6-e0c4-453c-89af-a46e8a04b2bb/extractor/0.log" Jul 06 19:02:46.355204 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:46.355174 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7d886d7d97-7jc9x_af86fd22-41b9-4691-b741-46d813955a5c/maas-api/0.log" Jul 06 19:02:46.556452 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:46.556241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-88568c598-lw9qn_cadbbd5a-c465-4e24-8911-beb3e216cdff/kube-auth-proxy/0.log" Jul 06 19:02:46.673608 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:46.673576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-gq4nr_18462f9b-edd0-4c24-9812-69d8ae2a4557/payload-pre-processing/0.log" Jul 06 19:02:46.708095 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:46.708057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdf75475b-t8nlc_fba1e27e-32f9-4847-9b32-268e9de8e3bc/manager/0.log" Jul 06 19:02:46.778014 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:46.777985 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f6df67dcf-4vpzr_3d9bd0df-c5ad-4e06-af60-5810eacd4801/router/0.log" Jul 06 19:02:47.161371 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:47.161285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf95b557-bhfr4_a34fd8b1-56e1-4264-99ad-ad6a4a94022e/manager/0.log" Jul 06 19:02:47.219494 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:47.219470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf95b557-bhfr4_a34fd8b1-56e1-4264-99ad-ad6a4a94022e/copy-manifests/0.log" Jul 06 19:02:48.439570 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:48.439495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-88568c598-lw9qn_cadbbd5a-c465-4e24-8911-beb3e216cdff/kube-auth-proxy/0.log" Jul 06 19:02:48.612815 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:48.611757 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-gq4nr_18462f9b-edd0-4c24-9812-69d8ae2a4557/payload-pre-processing/0.log" Jul 06 19:02:48.733844 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:48.733755 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f6df67dcf-4vpzr_3d9bd0df-c5ad-4e06-af60-5810eacd4801/router/0.log" Jul 06 19:02:48.910281 ip-10-0-132-134 kubenswrapper[2574]: I0706 19:02:48.910249 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77945c4cd8-8kh5v_c2e0204f-b3fc-484e-adaf-a56727ec0d84/manager/0.log"